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CHAPTER  1 


GENERAL  PRINCIPLES  OP  DIGITAL  FILTERING 


Data  reduction  includes  an  inherent  requirement  to  filter 
measured  data.  The  part  of  the  measured  values  which  is  noise, 
that  Is,  which  does  not  characterize  the  phenomenal  being  mea¬ 
sured,  must  be  removed  so  that  the  data  expresses  the  character¬ 
istics  of  the  system  being  tested.  (A  system  is  a  device  which 
interrelates  the  excitation  and  the  response.)  Often  it  is 
necessary  to  perform  integration  and  differentiation  based  on 
measured  data.  The  digital  fitter  is  a  means  by  which  these 
operations  can  be  performed.  Without  data  filtering,  the  mea¬ 
surements  and  the  derived  valuer, .from  these  measurements  often 
depict  physical  phenomena  that  are  virtually  impossible.  Air¬ 
craft  and  missiles  are  predictable,  so  it  is  possible  to  design 
filters  which  model  their  physical  performance. 

The  application  of  digital  filters  is  continually  growing  as 
more  computers  are  placed  in  line  in  the  measuring  systems,  as 
classical  measurement  systems  are  being  upgraded,  and  as  new 
measuring  data  concepts  are  being  introduced.  Video  signal  image 
enhancement,  video  signal  transmission,  the  Global  Positioning 
System,  and  aircraft  onboard  systems  will  necessitate  the  devel¬ 
opment  of  new  digital  filtering  theories.  Filters  havn  many 
different  functions;  for  example,  filters  are  used  in  water 
purification  to  remove  those  particles  which  are  undesirable. 
Filters  are  also  used  in  coffee  pots  to  keep  the  grounds  separate 
from  the  liquid.  Digital  filters  serve  much  the  same  purpose; 
they  separate  true  data  from  errors  which  are  added  during  the 
measurement  process. 

Signal  processing  filters  were  originally  circuits  with 
frequency  selection  characteristics.  Some  of  the  filters  which 
developed  as  a  result  of  this  concept  were  the  Butterworth,  the 
Chebyshev,  and  the  elliptic.  These  filters  can  be  designed  to 
meet  some  specific  criteria  regarding  amplitude  and  phase  re¬ 
sponse,  but  because  filters  of  this  type  work  on  data  frequency 
characteristics,  they  are  not  very  useful  in  their  original 
realizations  on  data  recorded  in  digital  form.  There  are  time 
domain  realizations  which  exhibit  similar  characteristics  on  time 
domain  data.  When  digital  realizations  exist  in  software,  a 
design  error  can  be  easily  corrected;  when  they  do  not  exist, 
however,  roundoff  error,  storage  requirements,  and  delays  become 
important  design  factors. 

Digital  filters  are  not  always  derived  from  a  frequency 
domain  realization.  Filters  can  be  used  directly  with  digital 
data,  based  on  the  statistical  characteristics  of  the  useful 
signal  and  noise.  The  Kalman  filters  belong  to  this  class  of 
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filters.  Some  of  the  principles  used  in  filters  of  this  type 
were  developed  by  Gauss  in  his  concept  of  weighted  least  squares. 
Although  he  used  this  concept  in  data  analysis,  it  was  not  until 
the  advent  of  digital  computers  that  the  full  potential  of  this 
concept  was  real  ized.  A  few  extensions  have  been  added  to  Gauss’ 
work,  and  many  techniques  have  been  developed  based  on  his 
principles. 

Related  to  digital  filters  are  the  terms  smoother,  filter, 
predictor,  and  wild  point.  These  terms  are  included  because  the 
range  surveys  in  appendix  A  include  references  to  these  terms. 
Given  measurements  in  the  time  interval  [0,t],  a  smoother  produc¬ 
es  estimate's  for  times  t^  <  t  ,  a  f  i  I  ter  produces  estimates  for 
times  =  t,  and  a  pr ed  i  c  tor  produces  estimates  for  times 
tp  >  t.  Thus,  optimal  estimates  are  obtained  postfl ight  by 
smoothers  (using  a  I  I  recorded  data)  and  are  obtained  in  real  time 
by  filters  (using  all  uata  up  to  the  present).  A  wild  point  is  a 
measured  data  value  that  fails  to  meet  some  predetermined  statis¬ 
tical  criteria.  A  "wild  point  application"  of  a  digital  filter 
is  the  replacement  of  a  wild  point. 

A  few  of  the  current  digital  filtering  applications  by  the 
Range  Commanders  Council  (RCC)  member  ranges  are 

(1)  in  rocket  firing  to  give  position,  velocity,  and 
acceleration  in  real  time  for  range  safety  information: 

(2)  in  inertial  navigation  where  navigation  errors 
have  to  be  estimated  in  real  time  for  corrections  to  be  appi ied; 

(3)  in  radar  and  theodolite  data  processing  to  give 
traj -ic:  tory  estimates  for  position,  velocity,  and  acceleration; 

(4)  in  satellite  trajectory  determination; 

(5)  in  processing  airplane  flight  test  data;  and 

(6)  in  reconstructing  photographs  or  voices  which  have 
been  transmitted  digitally. 

Tnis  document  catalogues  some  types  of  digital  filters 
widely  used  by  the  RCC  member  ranges,  explores  the  principles 
behind  these  filters,  and  shows  the  design  techniques  ror  specif¬ 
ic  applications.  Obviously,  a  rigorous,  theoretical  treatment  of 
the  subject  cannot  be  given  in  this  document,  nor  can  all  the 
details  of  design  techniques.  The  intent  is  to  give  the  reader  a 
feei  fer  the  subject  of  digital  filtering  as  defined  by  the 
members  of  the  RCC  Data  Reduction  and  Computer  Group.  Noted  are 
the  appropriate  bibliography  references  for  any  of  the  subject 
areas  where  more  detail  might  be  helpful  to  the  reader. 
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1  . 1  TImg  Domain  Maa«ur«m>nt  Data 


Two  representations  can  be  used  for  discrete  data  in  the 
time  domain.  The  most  commonly  used  definition  for  a  sampled 
function  is  the  sequence  {f(n){  whose  elements  are 


f(n)=f(t(n))=f(t) 


t=t (n) 


(1-1) 


where  n  is  an  index  for  the  times  at  which  samples  are  taken  and 
f(t)  is  the  continuous  function  from  which  the  samples  are  taken 
In  further  discussion  in  this  paper,  this  r eor esentat i on  will  be 
used  for  measurement  data.  Another  mathematical  representation 
for  a  sampled  function  in  the  time  domain,  f#{t),  is 


f*(t)  =  E  f(t(k))  a(t-t(k))  (1-2) 

k 

where  the  t(k)’s  are  the  instants  in  time  at  which  the  function 
is  sampled  and  <S(t)  is  the  Dirac  delta  function  or  impulse  func¬ 
tion  having  the  properties  of 


<5  (t-a) 


0  t  #  a 

00  t  =  a 


(1-3) 


a  +  6 

f  6( t-a) 


a-G 


dt 


6  >  0 


(1-4) 


The  above  definition  of  6(t)  is  from  reference  47,  page  15. 

Another  corrmon  definition  is 

6 ( t)  =  0 ,  t#0 , 

6(0)  =  00,  and 

6 

J  6(t)dt  =  1 .  e  >  0  (1-5) 

-e 

As  explained  in  reference  48,  page  70,  the  function  represents  an 
imaginary  rectangle  whose  base  is  0,  height  is  ou,  and  area  is  1. 

Thti  first  representation  all  ows  filters  to  be  analyzed  using 
some  of  the  calculus  techniques  of  continuous  functions  and 
allows  oridging  of  the  gap  between  discrete  and  continuous 
analysis..  In  many  current  papers  on  this  topic,  the  mathematical 
model  fur  the  measurements  and  the  state  of  a  system  are  given  in 
terms  o  *■  vectors.  In  this  notation,  a  group  of  variables  is 


1-3 


treated  as  one  vector  variable;  hence,  a  compactness  of  notation 
is  obtained,  and  very  general  filters  can  be  discussed  without 
becoming  immersed  in  details.  For  the  sake  of  completeness,  this 
representation  is  mentioned  here. 

Consider  a  sequence  of  measurements  which  are  represented  in 
a  form  similar  to  equation  (1-2).  instead  of  considering  a 
sequence  of  real  numbers,  consider  a  sequence  of  vectors,  iXCn)). 
A  particular  element  X(n)  of  this  sequence  consists  of  measure¬ 
ments  made  at  time  t(n)  and  should  relate  to  the  true  state  of 
the  process  from  which  the  measurements  were  taken.  For  in¬ 
stance,  X(n)  could  consist  of  measurements  of  azimuth,  elevation, 
and  range  for  some  object  in  space.  It  is  known  that  the  se¬ 
quence  ix(n))  can  be  related,  for  example,  to  the  position, 
velocity,  and  acceleration  in  the  x,  y,  and  z  directions.  Now 
assume  that  the  true  state  of  the  process  Y(t)  can  be  represented 
by  the  differential  equation 

=  F(Y{t)  ,t) 


where  Y(t)  is  a  vector  composed  of  scalar  functions  y(t,1),..., 
y(t,N)  and  all  the  derivatives  of  each  of  these  scalars; 

F(Y(t),t)  is  a  vector  function  that  is,  in  general,  nonlinear  and 
has  as  each  element  a  function  of  all  the  elements  in  Y.  Y(t)  is 
known  as  the  state  vector  and  could  consist  of  x,  y,  and  z 
coordinate  positions  along  with  the  first  and  second  derivatives 
of  these  positions,  for  instance.  Further  assume  that  X(n),  the 
measurement  vector,  is  related  to  the  state  vector  as 

X(n)  =  G (Y ( t (n) ) , t (n) )  +  N(n)  (1-7) 

where  G  is  the  measurement  function  of  the  state  variable  and 
N(n)  IS  the  noise  vector  or  the  measurement  error  vector.  In 
many  appl  ications,  equation  (1-6)  constitutes  a  I  inear  and 
homogeneous  system,  and  the  relationship  between  the  measurement 
vector  and  the  state  vector  is  assumed  linear.  In  this  case, 
equations  (1-6)  and  (1-7)  reduce  to 

^  =  A(t)Y(t)  (1-8) 

dt 

X(n)  =  M(n) Y(n) +N(n)  (1-9) 

where  A(t)  is  a  matrix  function  of  time  and  IVI(n)  is  a  matrix 
known  as  the  measurement  matrix.  In  digital  filtering,  equations 
(1-6)  and  (1-7)  are  used  to  give  some  type  of  best  estimate  for 
Y  ( t)  . 


In  many  cases,  the  measurements  are  made  on  certain  elements 
of  the  state  vector  itself;  that  is,  the  measurement  and  state 
vector  frequently  represent  the  same  test  item.  For  example,  an 
airplane’s  azimuth  and  elevation  may  be  measured  from  several 
different  stations  to  obtain  its  "true"  azimuth  and  elevation. 

In  this  case,  the  matrix  M(n)  is  diagonal  and  contains  only  1s 
and  Os  on  the  diagonal.  Most  future  discussions  will  operate 
under  this  assumption.  For  ease  of  understanding,  this  document 
will  consider  the  case  where  an  attempt  is  made  to  estimate  one 
variable  from  measurements  made  on  that  variable.  The  state 
differential  equation  will  be  implied  rather  than  given  explicit¬ 
ly. 

1 • 2  Error  Assumptions 

In  digital  filter  analysis,  three  types  of  errors  are 
considered:  (1)  errors  in  the  mathematical  model,  (2)  random 

errors  in  the  observations,  and  (3)  unwanted  discrete  frequencies 
in  the  observa c i ons .  The  first  type  of  error  is  caused  by  a  lack 
of  understanding  of  the  physical  system  for  which  the  estimate  is 
to  be  made.  The  second  error  type  is  due  to  inaccurate  measure¬ 
ments  and  is  assumed  to  be  normally  distributed  and  unbiased. 

The  third  error  type  is  caused  by  either  the  reception  of  noise 
along  with  the  desired  frequency  signal  or  the  intention  to  block 
out  one  or  more  bands  of  frequencies  to  suit  a  specific  app I  ica- 
tion.  (If  a  digital  filter  is  used  for  the  second  reason,  then 
the  third  type  of  "error"  is  not  really  an  error.) 

The  random  errors  are  discussed  next.  Assume  that  {x(n)}  is 
a  sequence  of  measurements  corrupted  by  noise  le(n))  and  that  the 
true  value  of  the  process  is  given  by  {Y(n)}.  In  all  applica¬ 
tions  the  noise  is  considered  to  be  additive  so  that  the  equation 
relating  the  state  variable  to  the  measured  variable  at  time  t(n) 
is  given  by 

x(n)  =  Y(n)+e(n).  (1-10) 

It  IS  often  assumed  that  the  noise  is  Gaussian  with  zero  mean  and 
uncorrelated  with  itself.  The  quantity  which  is  most  often  used 
to  characterize  the  noise  is  the  variance  given  by  equation 

«  1  N 

=  -  Ee(i)^  (1-11) 

N  i  =  1 

where  N  is  the  total  number  of  measurements  being  considered.  How 
much  this  variance  is  reduced  by  the  filter  may  be  used  as  the 
criterion  for  determining  the  filter  characteristics.  Caution 
must  be  exercised  when  using  this  criterion,  because  ie(i))  is  a 
time  sequence  and  thus,  in  most  cases,  correlated  with  itself. 
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Now  consider  errors  of  unwanted  discrete  frequencies  in  the 
observations.  Again  consider  the  relationship  between  the  true 
value  Y(n).  the  measurement  x(n),  and  the  error  ein)  to  be  of  the 
form  in  equation  (1-10)  with  {e(n))  being  a  signal  containing 
unwanted  frequencies.  In  this  case,  it  is  assumed  that  iV (n) I 
and  (e(n))  are  not  in  the  same  frequency  band.  This  property  is 
best  illustrated  using  the  power  spectral  density  function,  the 
quanrity  which  indicates  the  extent  that  a  particular  range  of 
frequencies  present  in  the  data.  In  the  case  when  the  frequency 
range  of  the  signal  and  error  are  nonoverlapping,  then  the  power 
spectral  density  function  G(o)  would  appear  as  shown  in  figure 
1  -1  . 


Figure  1-1.  Graph  of  power  spectrum  G(tt)  versus  frequency 
Q,  comparing  true  frequency  signal  lY(n))  with 
noisy  frequency  signal  {e(n)). 


In  this  case,  a  filter  would  be  designed  having  a  frequency 
response  such  that  lYfn))  would  pass  through  unchanged,  whereas 
(e(n)}  would  be  suppressed  as  much  as  possible. 

The  oower  spectral  density  function  for  Gaussian  white  noise 
'S  a  constant  as  shown  in  figure  1-2.  When  le(n;l  is  of  this 
form,  the  signal  and  noise  are  in  overlapping  frequency  ranges; 
hence,  part  of  the  noise  is  treated  as  signal  and  is  not  sup¬ 
pressed.  However,  the  desired  signal  is  often  of  a  low  enough 
frequencv  and  of  a  sufficient  amplitude  that  most  of  tne  noise  in 
this  freciuency  range  can  be  neglected. 


G 


Figure  1-2.  Power  spectrum  of  Gaussian  white  noise. 


1 .3  Beslo  Purposa  and  Fllfr  U«s 

Filters  are  used  to  aficertain  information  about  a  process 
from  measurements  made  on  that  process  when  these  measurements 
are  corrupted  by  noise.  Any  of  the  following  data  should  be 
incorporated  into  the  filter  if  known: 

(1)  the  differential  equations  describing  the  process, 

(2)  the  statistics  describing  the  noise,  and 

(3)  the  frequency  range  of  the  signals  describing  the 

process . 

In  many  applications  the  differential  equation  describing  the 
system  is  not  known.  In  these  cases,  it  is  often  assumed  that 
over  small  enough  time  intervals  the  differential  equation  of  the 
process  is  given  by 


d'^y 

- -  =  0  (1-12) 

d  t^ 

for  some  positive  integer  k. 

The  noise  most  often  encountered  in  physical  applications  is 
Gaussian;  however,  often  the  variance  is  not  known.  When  the 

variance  of  the  noise  is  not  known,  a  least  squares  criterion  is 

often  used  to  design  a  filter.  The  least  squares  criterion 
r equ  ires  that 

N 

^  {y{n)-y(n))^  =  ®  minimum  (1-13) 

n=0 
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where  tyln)}  is  the  sequence  obtained  by  some  type  of  fit  to  the 
data,  which  is  used  to  give  a  filtered  output.  Combin4ng  equa¬ 
tions  (1-12)  and  (1-13)  gives  birth  to  the  many  filters  which  are 
based  on  least  squares  polynomial  approximation.  There  are  many 
variations  of  these  filters  used  in  a  variety  of  applications  in 
both  real  and  nonreal  time.  Probably  the  widest  application  of 
these  filters  is  found  in  the  processing  of  tracking  data.  For 
example,  in  processing  radar  data,  azimuth,  elevation,  and  range 
are  measured.  From  these  measurements  a  raw  x,  y,  and  z  are 
computed.  The  digital  filter  is  used  to  obtain  smoothed  values 
for  X,  y,  and  z  as  well  as  the  first  and  second  derivatives  for 
these  quantities.  Other  uses  for  filters,  based  on  least  squares 
polynomials,  include  processing  of  theodolite  tracKing  data  and 
obtaining  rates  of  climb  and  accelerations  from  altitude  and 
airspeed  data  measured  onboard  an  airplane.  When  the  differen¬ 
tial  equation  describing  the  process  and  the  statistics  of  the 
noise  are  both  known,  then  a  Kalman  filter  can  be  used  to  esti¬ 
mate  the  process.  The  Kalman  filter  has  found  wide  application 
in  the  fields  of  guidance  and  navigation.  (The  Kalman  filter  is 
discussed  in  chapter  6.) 

When  the  signal  describing  the  process  lies  in  a  certain 
frequency  band,  a  filter  is  designed  which  will  allow  only‘the 
fiequencies  in  this  band  to  pass.  (Passing  frequencies  of  a 
certain  band  are  discussed  in  chapter  4.)  These  filters  are  used 
for  square-law  detection,  frequency-selective  smoothing,  phase 
and  amplitude  determination,  arid  smoothing  differentiation. 
Specific  appiications  include  processing  of  digitally  transmitted 
photograons,  medical  records,  and  tracking  data.  The  determina¬ 
tion  of  the  best  filter  for  any  particular  application  requires  a 
careful  analysis.  The  filter  which  is  ultimately  selected  will 
depend  oi-'  the  physical  system  under  analysis,  the  type  of  mea- 
surement*:.  being  taken,  and  the  constraints  in  computation  time. 

1 . 4  L I  near  F I  I f r» 

Linear  filters  are  filters  which  conform  to 

F(x+ay)  =  F(x)+aF(y),  (1-14) 

where  F  .cenotes  the  filtering  operation,  x  and  y  denote  inputs  to 
the  T  I  I  ter  ,  ana  a  is  a  constant.  For  such  filters,  the  output  at 
a  particular  time  equals  the  input  multiplied  by  a  set  of  weights 
which  are  not  a  function  of  the  output  as  given  by  the  equation 

y(k)  =  r j h (k . j ) X ( k- j )  (1-15) 

The  set  in(k,j))  denotes  the  weighting  function  described  in 
paragrarih  1.5.  The  advantage  of  linear  filters  is  that  they 
operate  on  signal  and  no i ae  independently,  so  it  is  relatively 
easy  to  oetermine  how  they  will  treat  both  signal  and  noise. 

Most  of  the  filters  in  current  use  are  linear;  least  squares 
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moving-arc  polynomials  and  most  applications  of  frequency-con¬ 
strained  and  Kalman  filters  fall  in  this  category,  (The  least 
squares  moving-arc  polynomials  filter  is  discussed  in  chapter  7.) 
If  the  system  under  consideration  is  nonlinear,  then  some  type  of 
linearizing  scheme  is  used  so  that  some  of  the  nice  properties  of 
linearity  can  be  retained. 


Funot Ions 


To  illustrate  the  idea  of  filter  weighing  functions,  consid¬ 
er  a  continuous  linear  filter  having  one  input  variable  and  one 
output  variable.  Such  a  filter  is  defined  by 


OQ 

y(t)  =  J  hlt.T)x(t-T)dT  (1-16) 

-00 


The  integral  in  equation  (1-16)  is  the  well-known  convolution 
integral.  Here  x(t)  is  the  input,  y(t)  Is  the  output,  and  h(t,T) 
is  the  filter  weighing  function.  The  discrete  analog  to  equation 
(1-16)  is 


y(j)  =  r  h(j ,k)x(j-k)  (1-17) 

k 

where  lx(j)}  is  the  input  sequence,  (y(j))  is  the  output  se¬ 
quence,  and  (h(j,k))  is  a  set  of  weights  corresponding  to  the 
weighing  function  previously  defined.  The  last  equation  charac¬ 
ter,  as  the  nonrecursive  digital  filter  discussed  in  paragraph 
1.8.  The  summation  in  equation  (1-17)  is  known  as  the  convolu¬ 
tion  sum.  The  filters,  as  defined,  can  be  time  varying;  that  is, 
the  weighing  function  can  change  with  time.  In  the  continuous 
case,  if  h(t,T)  is  a  function  of  T  only,  then  the  filter  is  time 
invariant.  Similarly,  in  the  discrete  case,  if  lh(j,k))  is  a 
function  of  k  only,  then  the  digital  filter  is  time  invariant. 

The  equation  for  a  digital  filter  then  becomes 

y(j)  =  I  h(k)x(j-k)  (1-18) 

k 

A  digital  filter  is  time  invariant  when  the  system  is  being 
modeled  by  a  constant  coefficient  differential  equation,  and  the 
relationship  between  the  state  variables  and  the  measurements 
does  not  vary  with  time.  When  measurements  are  made  at  equal 
increments  in  time,  the  set  of  weights  for  a  t ime- i nvar i ant 
filter  remains  the  same  for  each  output  point.  Thus,  time 
invariance  is  a  desirable  feature  from  a  computational  point  of 
V  i  ew . 
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1  .6  Ganaral  Purpo««  FI  I  tars 


Many  filters  in  use  today  are  ganeral  purpose;  that  is,  they 
are  not  restricted  to  a  particular  application.  The  most  common¬ 
ly  used  of  these  filters  are  the  least  squares  polynomial  fil¬ 
ters.  These  filters  are  usually  designed  so  that  the  degree  and 
number  of  points  to  be  used  can  be  specified.  Within  this 
category  there  are  many  variations.  For  instance,  a  filter  can 
be  constrained  so  that  it  passes  through  the  last  filtered  point 
and  has  continuous  slope  through  that  point.  In  addition,  the 
specific  implementation  can  vary;  for  example,  the  recursive  sums 
or  orthogonal  polynomials  are  different  implementations  of  the 
polynomial  filters. 

Moat  of  the  frequency-constrained  filters  mentioned  in 
paragraph  1.4  are  general-purpose  filters.  Any  one  of  these 
filters  can  be  used  in  a  number  of  applications.  Some  uses  of 
general-purpose  filters  were  mentioned  in  paragraph  1.3.  In  many 
instances,  these  filters  can  be  moved  from  one  application  to 
another  without  modification. 

1  . 7  Spsolal  Purposs  FI  I  fra 

Certain  filters  are  designed  for  a  special  mission.  Once 
designe'd  and  checked  out,  these  filters  then  ideally  remain  the 
same  for  the  duration  of  the  mission.  Two  important  categories 
of  special  purpose  filters  are  range  safety  and  navigation 
system..  An  example  of  a  special  purpose  range-safety  filter  is 
the  QD  filter,  (see  paragraph  7.7).  This  filter  is  suited  for 
its  mi'jsion  because  of  the  speed  with  which  it  can  deliver 
smootht’d  position,  velocity,  and  acceleration  in  real  time.  It 
also  has  the  ability  to  do  spike  editing  in  real  time.  (Spike 
editing  is  defined  as  editing  out  the  wild  points  or  spikes.) 

For  navigation  filtering,  special  implementations  of  the  Kalman 
filter  are  usually  used.  The  Kalman  filter  is  well  suited  for 
this  application  because  of  its  ability  to  give  optimal  estimates 
of  a  system’s  state  variables  in  time. 

I . 8  Nonreoursive  Filters 

In  paragraph  1.5,  a  digital  filter  was  defined  in  equation 
(1-17).  For  a  filter  defined  in  this  way,  each  output  point  is  a 
function  only  of  the  input  and  t^e  weighing  function.  Any  filter 
for  which  the  current  output  is  not  a  function  of  previous 
outputs  such  as  the  one  defined  by  equation  (1-17)  is  said  to  be 
nonrecursive.  Nonrecursive  filters  are  analogous  to  open-loop 
filters  in  servomechanisms.  Many  implementations  of  the  least 
squares,  polynomial  filters  and  of  the  frequency- constr  a  i  ned 
filters  fall  into  this  category.  Such  filters  are  not  subject  to 
problems  of  instability;  that  is,  an  error  occurring  in  a  comput¬ 
ed  output  point  does  not  propagate  into  future  output  points. 
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It  the  right-hand  side  of  equation  (1-18)  represents  a 
finite  sum,  then  it  is  called  a  finite  impulse  response  (FIR) 
system  or  FIR  filter.  In  FIR  filters,  if  the  right-hand  side  of 
equation  (1-18)  contains  q  terms,  then  the  filter  can  have  an 
impulse  respunse  at  most  q  samples  long.  If  the  last  impulse 
occurred  more  than  q  samples  ago,  the  entire  right-hand  side  of 
equation  (1-18)  is  zero.  A  presentation  of  design  methods  using 
FIR  filters,  along  with  a  summary  of  advantages  and  disadvantages 
of  using  this  filter  type,  is  given  in  chapter  5. 

1 < 9  Recursive  F I  I te rs 

Recursive  filters  use  past  output  values  in  computing  the 
current  output  value.  These  filters  take  advantage  of  past 
computations  in  such  a  way  that  output  values  are  used  to  yield 
information  about  previous  input  values  to  the  filter.  In  this 
way,  storage  and  computation  time  are  saved.  The  general  form  of 
a  recursive  filter  having  one  input  and  one  output  is 

N  M 

y(k)  =  I  a(j)x(k-j)  +  £  b(j)y(k-j)  (1-19) 

0  1 

where  (x(j)}  is  the  input,  {y(j))  is  the  output,  and 
ta  ( j )  ,  b  ( j )  ,:,  j  =  1  ,  .  .  ,  I  is  the  set  of  weights.  Some  recursive 
filters  (for  example,  Kalman  and  QD)  use  the  previous  output  to 
predict  a  value  for  the  current  output  and  Ui;e  the  current 
measured  input  to  correct  the  current  output.  Recursive  filters 
are  analogous  to  closed- loop  filters  in  servomechanisms.  Another 
commonly  used  name  for  such  filters  is  infinite  impulse  response 
(MR)  filters  or  MR  systems.  In  MR  filters,  all  outputs  y(k) 
will  be  influenced  by  all  previous  impulse  responses  a(j)  in 
equation  (1-19)  regardless  of  how  large  k  is.  Each  impulse  re¬ 
sponse  has  an  influence  on  an  infinite  number  of  terms  y(k). 

The  savings  in  computation  time  and  storage  achieved  by 
using  recursive  filters  do  not  come  without  a  price.  If  not 
properly  designed,  the  filters  can  suffer  from  instability. 
Because  each  filter  is  computed  from  previous  values  y  ( j ) , j <k ,  an 
error  induced  in  any  one  of  these  y(k)'s  will  have  an  effect  in 
each  future  y(k).  If  such  errors  do  not  die  out  as  k  increases, 
then  the  filter  is  unstable  and  is  not  usable.  Ways  of  analyzing 
the  stability  characteristics  of  filters  are  discussed  in  chapter 
2.  Another  factor  to  consider  in  using  recursive  filters  is  the 
fact  that  they  are  not  self  starting.  For  the  first  few  output 
points  there  will  be  no  previous  outputs  to  use  in  equation 
(1-19).  Hence,  some  other  method  must  be  devised  through  which 
the  initial  y(k)’s  are  determined.  Methods  of  choosing  starting 
values  depend,  of  course,  on  the  particular  application  in 
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question  and  are  discussed  in  references  1  and  42  and  in  chapter 
7.  A  presentation  of  design  methods  using  IIR  fi  iters,  along 
with  a  summary  of  advantages  and  disadvantages,  is  given  in 
chapter  5. 

1.10  F  I  I  tar  Weights  Crnstruotion 

Again  consider  a  nonrecursive,  nontime-varying  linear  filter 
of  the  form 


y(k)  =  I  h(j  ,k)x(k-i)  (1-20) 

j 

The  problem  in  designing  a  filter  is  finding  the  weights  ih(j,k)} 
in  such  a  way  that  some  design  criterion  is  satisfied.  Some  of 
the  examples  discussed  in  succeeding  chapters  are 

(1)  choosing  weights  by  requiring  that  the  span  of 
ix(j)}  under  consideration  be  fitted  by  a  least  squares  polynomi- 
na  I  , 


(2)  choosing  the  weights  using  Fourier  methods  by 
requiring  that  the  frequency  response  of  the  filter  fit  an 
idealized  frequency  response  function,  and 

(3)  using  the  z-transform  to  derive  filter  weights 
from  the  transfer  function  of  a  given  analog  filter  (see  chapter 
3)  . 


Wlipn  the  filter  is  recursive,  and  thus  takes  the  form 
N  M 

y(k)=  r  a(j)x(k-j)  +  £  b(j)y(k-j)  (1-21) 

0  1 

then  there  is  a  corresponding  nonrecursive  filter  which  is 
theoretically  the  same.  In  this  case,  the  weights  are  either 
derived  in  terms  of  the  corresponding  weights  for  the  nonrecurs¬ 
ive  case  or  are  derived  directly  using  z-transforms . 
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CHAPTER  2 


FILTER  ANALYSIS  IN  THE  TIME  DOMAIN 


2 . 1  Fllfr  Characf  r  lit  lo«  Analyla 

Analysis  of  a  filter  in  the  time  domain  consists  of  deter¬ 
mining  the  characteristics.  These  characteristics  are 

i1)  Stability.  With  a  unit  impulse  input  to  a  recurs¬ 
ive  filter,  the  filter  is  unstable  if  the  output  oscillates  or 
never  dies  down  to  zero  amplitude  or  attenuates. 

(2)  Attenuatijn.  With  a  nonzero  input  parameter, 
attenuation  is  the  amount  the  filter  has  reduced  its  amplitude  in 
the  output. 

(3)  Time  Lag.  The  amount  of  time  it  takes  for  a 
filter  to  supply  a  best  estimate  of  an  input  parameter. 

(4)  Distortion.  Attenuating  or  amplifying  amplitudes 
of  different  frequencies  by  different  amounts  in  an  undesirable 
manner  is  called  distortion.  If  the  filter  causes  minimal 
distortion,  it  is  a  good  fit  or  we  I  I -mode  led 

To  analyze  these  characteristics,  the  following  techniques  are 
frequently  used: 

(1)  Autocorrelation 

(2)  Unit  Impulse  Response 

(3)  Variance  Reduction  Factor 

(4)  Simulation 

(5)  Monte  Carlo  Methods 

(6)  Residuals 

2 . 2  Autocorra I  at  I cn 

When  data  are  fed  into  a  filter,  the  output  data  may  be  more 
(linearly)  correlated  in  time  than  the  input  data:  that  is, 
series  or  output  data  values  may  be  more  correlated  than  their 
corresponding  series  of  input  data  values.  The  tvpe  and  amount 
of  this  additional  correlation  will  depend  on  the  filter  weights 
which  are  used  as  data  multipliers.  For  example,  if  the  filter 
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frequency  response  has  large  side  lobe  effects  ana  passes  fre¬ 
quencies  which  were  supposed  to  be  suppressed,  the  resultant 
output  will  show  these  effects  and  they  can  be  measured  if  the 
serial  autocorrelation  in  the  data  is  estimated.  The  serial 
autocorrelation,  used  in  analyzing  time  lag,  is  computed  by 


r  Ik) 


N-k 

I 

1  =  1 

(x(i)-x(l)) (x(i+k)-x(2)) 

(2-1) 

N-k 

N-k 

1/2 

1 

X 

1 

X  1 

£ 

(x(  i+k)-x(2) 

1 

I 

i  =  1 

i  =  1 

i 

where  xll)  and  x(2)  are  the  means  of  the  first  N-k  and  the  last 
N-k  data  Doints  and 


M  =  number  of  points  in  the  sample, 
k  =  0,1,2,...,  M<N,  the  number  of  lags. 

The  value  r (k)  represents  the  (linear)  correlation  between  the 
first  and  last  N-k  data  values  from  a  series  of  N  points.  This 
technique  can  be  used  in  conjunction  with  simulation  techniques 
by  entering  white  noise  into  the  filter  and  then  measuring  the 
autocorrelation  of  the  output.  The  amount  of  correlation  imposed 
on  the  data  by  the  filter  is  thus  estimated. 


Caution  must  be  used  if  an  attempt  is  made  to  "smooth"  the 
same  data  more  than  once  in  a  sequential  manner  because  of  the 
correlation  which  may  be  imposed  on  the  data  by  the  first  smooth¬ 
ing  process.  In  cases  where  it  is  desirable  to  smooth  position 
and  then  again  smooth  computing  velocity,  a  thorough  analysis 
should  be  made  to  ensure  that  autocorrelation  imposed  by  the 
first  smoothing  process  does  not  bias  the  estimates  made  by  the 
second  process. 

2 . 3  Unit  Impulae  Reaponaa 

For  a  continuous,  linear,  t ime- i nvar i ant  system,  a  unit 
impulse  response  h(t)  can  be  defined  as  the  response  of  the 
system  at  time  t  because  of  a  unit  impulse  at  time  0,  that  is, 
because  of  4(0).  (Unit  impulse  is  another  term  for  impulse 
function  (see  page  1-3.))  A  system  is  linear  if  the  input 
c  j  f  ^  ( t ) +c  2  f  2  ( produces  an  output  c  j  g  ^  ( t) +0292  ^  f  ^  f^(t) 

and  f2(t),  where  inputs  f^(t)  and  f2^^^  produce  outputs  g^(t)  and 
g  />  ( t )  . 


The  input  f(r)  and  output  g(t)  of  the  system  are  related  by 


00 

Qit)  =  J  h(T)f(t-T)d'r 
-00 


l2-2) 


where  h(T)  is  the  unit  impulse  response,  Thus,  the  output  equals 
the  convolution  of  the  unit  impulse  response  and  the  input. 

For  a  discrete,  linear,  t ime- i nvar i an t  system,  the  unit 
impulse  response  is  the  sequence  where  h^^  is  the  response  of 

the  system  at  state  n  caused  by  a  unit  impulse  at  state  0.  For 
the  discrete  case,  the  input-output  relationship  can  be  described 
as 


00 

=  I 

m=“00 


m  n-m 


(2-3) 


where  ^^n*  input  and  output  signals,  and  is 

the  unit  impulse  response. 


For  either  case,  the  output  of  a  linear,  t  rnne- i nvar i ant 
system  is  thus  the  convolution  of  its  input  and  its  unit  impulse 
response.  For  this  ourpose,  equation  (2-3)  will  represent  the 
system  of  interest,  since  digital  filters  are  defined  to  be 
discrete,  linear,  t ime- i nvar i ant  systems.  As  seen  from  equation 
(2-3),  tne  unit  impulse  response  can  be  regardea  as  a  set  of 
weights.  Thus,  from  what  was  discussed  m  paragraph  1.5,  the 
unit  impulse  response  completely  determines  the  characteristics 
of  a  digital  filter.  Reference  can  then  be  made  either  to  f  e 
weights,  given  past  data,  in  tne  averaging  process  or  to  the  unit 
impulse  response. 


in  reality,  it  is  impor  tant  to  know  how  much  a  f i  I  ter 
distorts  a  deterministic  input.  One  way  to  determine  the  distor¬ 
tion  IS  to  analyze  unit  impulse  response.  The  z-transform  is  a 
convenient  tool  for  the  analysis  of  the  response  of  digital 
filters  when  tne  unit  impulse  response  is  known.  The  z-transform 
for  a  sequence  is  defined  as 

00 

^iz)  =  j: 

ri=-oo 


Stated  earl ler  in  this  section  is  that  tne  output  the 
system  i:an  be  found  by  convolving  the  input  anc  .jnit  impulse 
response.  The  output  can  be  found  easier  througri  the  use  of  the 
z-transform.  An  e*arppie  taken  from  reference  50  demonstrating 
tht!  use  of  the  z-transform  in  determining  the  output  signal  or 
the  unit  impulse  response  is  described  next. 


Let  the  input  signal  be  (2  11  and  the  unit  impulse  response 
be  18  4  2  11.  Referring  to  equation  (2-2),  the  Convolution 
Theorem,  which  states  that  the  z-transform  cf  the  convolution  of 
two  functions  is  equal  to  the  product  of  tne  z-transforms  of 
those  functions,  is  applied  (see  reference  23  or  50).  The 
2-transforms  of  the  input  signal  and  unit  impulse  response  are 

2  +  2~*  and  8  +  4z"'^  +  22”^  +  z~^  (2-5) 


The  product  of  those  z-transforms  is 

16  +  162“’  +  8z~^  +  4z~^  +  2”^.  (2-6) 

This  polynomial  is  the  z-transform  of  the  output  signal.  Hence, 
our  output  signal  is  116  16  8  4  1). 

To  find  the  impulse  response,  the  input  and  output  must  be 
given.  Then,  the  Convolution  Theorem  can  be  applied  by  dividing 
the  2-transform  of  the  output  by  the  z-transform  of  the  input  and 
expanding  the  result  as  a  polynomial  in  2  The  coefficients  of 

this  polynomial  represent  the  impulse  response.  To  find  the 
inpulse  response,  the  process  described  in  the  previous  example 
IS  reversed.  For  any  given  filter,  the  unit  impulse  response, 
which  returns  to  and  remains  at  zero,  is  an  indication  of  the 
filter’s  stability,  time-lag  characteristic,  and  amplitude 
attenuat 1  on . 


Another  means  of  specifying  a  filter  is  by  its  step  re¬ 
sponse,  which  IS,  the  response  to  a  constant  signal.  A  constant 
signal  is  represented  by  a  step  function,  which  is  described  as 


u ( t- a ) 


0  t  <  a 

I  t  >  a 


(2-7) 


The  unit  step  function  is  the  integral  of  the  unit  impulse 
function..  Likewise,  the  step  response  Is  the  integral  of  the 
impulse  response.  Quite  often,  the  function  used  is  equal  to  1 
for  a  fin.te  period:  that  is,  u(t)  =  1  for  a<l^b ,  for  some  b>a, 
and  u ( t)  =  0  for  t>b . 


Sometimes  in  actual  practice,  rather  than  using  the  impulse 
function,  a  smooth  input  step  function  is  generated.  A  smootn 
input  step  function  is  a  function  that  does  not  switch  values 
abruptly,  as  does  the  step  function  just  defined,  but  rather  that 
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changes  values  in  a  continuous  manner.  There  are  many  examples 
in  whicn  a  smooth  step  function  simulates  reai-iife  situations 
more  accurately  than  does  the  ideal  step  function.  For  example, 
the  acceleration  of  a  rocket  at  motor  burnout  ooes  not  vanish 
instantaneously,  but  tapers  off  to  zero  gradually. 

As  an  example  of  using  the  step  function,  the  smooth  input 
step  function  shown  in  figure  2-1  can  be  used  as  a  model  to 
evaluate  a  typical  general -purpose ,  recursive,  second -order 
filter.  (An  nth  order  filter  is  a  filter  that  can  be  designed 
with  an  nth  order  differential  equation.  The  acce i erat i on  at 
rocker  motor  burnout  discussed  in  the  previous  paragraph  can  be 
simulated  using  a  second-order  filter).  The  steo  response  is 
shown  in  figure  2-2.  A  recursive  filter  must  be  given  initial 
values,  since  each  output  value  depends  on  the  previous  output 
value.  The  first  three  points  in  figure  2-2  reoresent  the 
initial  values  used  by  the  prospect. ve  filter. 

2 . 4  Varlanca  Reduction  Factor 

Let  F  be  an  arbitrary  oigitai  filter.  Assort. e  that  the  input 
and  outDut  of  F  are  stationary  random  processes.  A  process  is 
called  stationary  if  its  statistics  such  as  mean  and  variance  are 
not  affected  by  a  shift  in  the  time  origin.  Theor e t i ca l I y , 
assume  tnat  F  has  been  filtering  the  same  process  for  an  infi¬ 
nitely  Icng  time  for  the  output  to  be  stationary.  Further, 
assume  tnat  each  of  the  noise  processes  for  the  input  and  output 
data  are  uncorrelated  with  themselves.  Let  v(l)  and  v(2)  be  the 
variances  of  the  input  and  output  random  processes.  Then  the 
variance  reduct 'on  factor  is  defined  as 

V (2)  (2-6) 

^  "  V  I  1  ) 

■'he  var  ance  reduction  factor  must  be  interpreted  with  caution, 
oecause  tne  assumptions  underlying  the  estimation  of  variances 
are,  in  most  cases,  not  real istic.  The  parametef  R  is  not 
necessar  ily  less  than  one,  although  R  is  generally  less  than  one 
in  a  practical  case. 
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Figure  2-2.  Real-time  response.  Point  span  ■'  20;  sampling 
period  -  0.05  seconds. 

'  f 


2.6  S Imu I  at Icn 


Ordinarily,  it  is  assumed  that  a  signal  process  s(t)  and  a 
noise  process  n(t)  defined  for  a  discrete  or  continuous  variable 
t  are  additive  resulting  in  a  process  denoted  by  s(t)  +  n(t).  A 
filter  is  used  to  suppress  n(t)  and  extract  s(t)  with  the  least 
amount  of  distortion  under  a  given  set  of  operational  criteria, 
for  example,  variance  reduction  factor,  impulse  response,  and 
computation  time.  These  factors  usually  vary  from  one  process  to 
another  depending  largely  on  the  values  of  s(t)  and  n(t)  even  for 
a  particular  filter.  It  is  therefore  often  des.red  to  examine 
various  response  characteristics  of  a  given  filter  applied  to  a 
specific  signal  plus  noise  process  s(t)  +  n(t).  The  objective  is 
to  compare  the  filtered  data,  say  s{t),  obtained  from  s(t)  +  n(t) 
against  the  originally  known  signal  process  s(t).  The  act  of 
perturbing  s(t)  with  an  additive  noise  process  n(t)  or  filtering 
s(t)  +  n(t)  or  both  is  called  the  simulation  of  the  signal  plus 
noise  process  or  of  the  filtering. 

The  simulation  techniques  are  classified  into  two  major 
categories;  hardware  simulations  and  numerical  simulations. 
Simulated  equipment  tests  and  scale  model  experiments  are  typical 
of  the  hardware  simulations.  In  the  case  of  the  numerical 
simulations,  the  entire  system  to  be  analyzed  must  first  be 
represented  by  an  appropriate  mathematical  model  in  the  form  of 
s(t)  +  n(t),  in  which  the  contribution  of  various  perturbations 
IS  treated  as  the  noise  process  n(t).  The  purpose  here  is  to 
concentrate  on  numerical  simulations. 

The  numerical  simulations  are  divided  into  digital,  analog, 
and  hybrid.  The  digital  simulations  use  digital  computers  as  the 
primary  simulation  tools  and  are  effective  for  discrete  processes 
of  the  form  s(i)  +  n(i),  i=1,...,  m.  They  are  particularly 

suited  for  highly  accurate  simulation.  Similarly,  the  analog 
simulations  are  made  using  analog  computers  or  similar  analog 
devices  and  are  suited  for  the  simulation  of  a  process  continuous 
in  time.  The  hybrid  simulations  involve  the  mixture  of  both  the 
digital  and  analog  simulations  incorporating  d i g i ta I - to-ana I og  or 
ana  I og- to-d i g i ta 1  conversion  processes  or  both.  By  the  nature  of 
their  construction,  neither  the  analog  nor  the  hybrid  computers 
can  achieve  a  high  degree  of  accuracy.  Digital  simulations  have 
become  more  frequently  used  as  the  primary  tools  for  analyzing 
systems  performance  and  operational  characteristics,  even  for 
those  processes  with  continuous  time  variables. 

Va-'ous  digital  filters  may  be  applied  to  the  output  process 
of  hardware  simulations,  digital  simulations,  or  digitized  values 
of  analog/hybrid  simulations.  The  performance  of  the  filters  is 
best  evaluated  under  the  conditions  of  the  closed-loop  simulation 
setup  in  figure  2-3,  In  a  closed-loop  simulation.,  the  signal 
process  s(t)  is  given  a  priori.  The  noise  process  n(t)  is 
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generated  using  random  noise  generators  or  random  number  genera¬ 
tors  and  is  added  to  s(t),  thus  forming  s(t)  +  n(t).  The  filter 
IS  applied  to  sit)  +  nit),  yielding  the  filtered  process  Sit). 
The  original  signal  process  sit)  is  fed  into  a  comparator  with 
appropriate  delay  to  form  the  difference  process  sit)  -  sit), 
which  usn  be  evaluated  for  the  performance  of  the  filter. 


Figure  2-3.  A  closed  loop  simulation  logical  diagram. 


2.0  Monte  Carlo  Methods 

An  analogy  of  the  random  numbers  used  in  digital  simulations 
to  the  random  outcomes  of  gambling  devices  such  as  roulette, 
dice,  and  cards  has  led  to  the  use  of  the  celebrated  term  "Monte 
Carlo"  since  the  inception  of  digital  simulations.  The  simula¬ 
tion  of  a  random  process  by  random  numbers,  fol lowed  by  the 
calculation  of  statistical  parameters  of  the  end  result  of  this 
piocess,  IS  called  a  Monte  Carlo  technique.  The  random  numbers 
in  question  can  be  generated  by  a  computer.  In  the  digital 
simulations  of  s(i)  *■  nli),  i  =  1,...,  m,  the  signal  process  sli) 

IS  assumed  to  be  known  a  priori  and  is  available  in  the  computer 
storage.  The  noise  process  nli)  is  frequently  assumed,  unless 
*acts  to  the  contrary  are  known,  to  be  independently  and  identi- 
Cci  I  I  y  d  I  t  r  i  bu  ted  random  variables  for  all  1  =  1,..  ,  mwith  a 

■iven  proDaoi  I  I ty  distr  iDution  function.  The  proolem  then 
.  /duces  to  the  generation  of  random  numbers  with  these  qualifica- 
t I ons . 


2.8.1  G<in«ftlon  of  Random  Numbara  From  m  G«nT«l  DIatrlbutlon 
Function 


Suppose  lx(k):  k  =  1,...,  ),  are  random  numbers  generated 
with  a  probability  density  function  f(x),  where  f (x)  can  be 
either  discrete  or  continuous  in  x.  Basic  concepts  for  the 
descrete  and  continuous  cases  are  described  in  the  foMowing 
subparagraphs. 

2. 8. 1.1  Definition  of  Olscrcf  Csss 

If  f{x)  is  discrete,  it  is  then  described  as  P(X  =  x) ,  where 
X  is  a  discrete  random  variable  (r.v.).  There  exists  a  probabil¬ 
ity  value  f(x(j))  for  each  random  number  x(j),  j  =  1,  2,..,,  « 
such  that 

f  (x  ( j)  )>  0,  j  =  1  .  2 . CO  (2-9) 


I  f(x(j))  =  1 
j  =  1 

The  cumulative  probability  F(x(n))  is  defined  to  be 

n 

F(x(n))  =  I  f(x{i)) 
i  -- 1 


(2-10) 


(2-1  1  ) 


It  is  the  probability  that  the  random  variable  X  equals  any  one 
of  the  fandom  numbers  x(1),  x(2),...,  x(n).  Notice  that 

I  im  F ( X ( n ) )  =  1  . 

n  -  >  00 

2. 6. 1.2  Method  of  Random  Number  Gsnsrstlon 

In  the  case  of  f(x)  being  continuous  in  x  over  the  range  of 
interest  [a,b),  f(x)  is  then  described  as  having  these  three 
proper  t i es 

f(x)  ^  0  for  all  X  in  [a,b3  (2-12) 

b 

J  f  (x)dx  =  1  (2-13) 

a 

d 

J  f (x)  dx  =  Plc<X<d} , 
c 
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where  X  is  a  continuous  r.v.  and  tc,d3  is  contained  in  c  (a.bl. 
The  cumulative  distribution  function  Fit)  is  defined  to  be 

t 

Fit)  =  J*  fix)  dx.  a  <  t  <  b  12-14) 

a 

Obviously.  Fla)  =  0,  and  Fib)  =  1.  12-15) 

2 . 6 . 1 . 3  Method  ot  Random  Number  Generation 

Let  ylk),  k=1 .  n,  be  random  numbers  uniformly  distribut¬ 

ed  between  0  and  1.  Random  numbers  x(k)  can  be  generated  from 
ylk)  by  finding  a  cumulative  distribution  function  F  mapping  x  to 
y.  so  that 


ylk)  =  Flxlk) ) .  12-16) 

Pick  F  so  that  the  new  random  numbers  xlk)  will  be  distributed  in 
the  manner  desired.  Now  generate  the  new  random  numbers  by  using 

xlk)  =  F"’ lylk) ) .  12-17) 

In  this  manner,  it  is  assured  that  the  source  ylk)  of  the  new 
random  numbers  xlk)  is  random  and  uniformly  distributed.  The 
uniqueness  of  xlk)  and  the  inverse  mapping  F'^lk)  can  be  seen 
immediately  from  figure  2-4.  Equation  12-17)  is  applied  often, 
since  random  number  generators  of  many  compilers  produce  numbers 
uniformly  distributed  between  0  and  1.  The  problem  then  narrows 
down  to  the  generation  of  the  random  numbers  ylk)  from  a  uniform 
d  I B  tr  i  bu  1.  I  on  over  (0,11. 


2.6.2  Random  Numbers  From  a  Uniform  Distribution 

Computers  have  mathematical  routines  which  generate  uniform¬ 
ly  distributed  random  numbers.  Various  different  earlier  pseudo¬ 
random  number  generators  have  been  examined  in  H.  A.  Meyer, 
liympos  1  ur.-i  on  Monte  Carlo  Methods,  John  Wiley,  New  York,  1956. 


One  technique  called  the  "congruence  method"  uses  the 
following  scheme.  Given  an  initial  random  number  xlk), 

0<>.  Ik)  <2'^- 1  ,  xlk+1)  IS  computed  recursively  by 

/lx  +  1)  =  lxlk)(1+2®]  +  1)  Imod  2*^)  12-18) 

where  a  =  (n/23  1[’)  is  the  greatest  integer  function).  This 

technique  is  frequently  used  to  generate  random  numbers  in  an 
r. -bit  binary  machine. 
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2 . 0 . S  R^noom  Normal  D«vi«f 

Anothar  kind  of  random  number  often  used  in  dij^ital  simula¬ 
tion  is  that  of  the  random  normal  deviates.  A  random  normal 
deviate  is  a  number  in  a  set  of  random  numbers  that  is  normally 
distributed.  Random  normal  deviates  are  used  to  simulate  a 
random  sample  from  a  standard  normal  distribution.  These  random 
numbers  can  be  generated  using  the  mapping  technique  described  in 
subparagraph  2.6.1  Mith  the  probability  density  function 

f{x)  *  exp(-x2/2).  (2-19) 


Figure  2-4.  Graphic  description  of  how  the  random  number 
x(k)  is  determined.  It  is  obtained  with  a 
cumulative  distribution  function  F{x(n))  (in 
top  graph)  or  F(x)  (in  bottom  graph)  and  a 
random  variable  y(k)  uniformly  distributed 
over  (0,1)  . 
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The  resultant  random  numbers  possess  zero  mean  and  unit  variance. 
For  the  generation  of  random  numbers  z(k),  k  =  1,...,  N,  with  a 
(nonstandard)  normal  distribution  with  mean  m  and  variance  v,  use 
the  transformation 

2(k)  =  m  +  v(x(k)),  k  =  1,...,  N.  (2-20) 

2 . 7  Rea  I  duals 

Some  filter  characteristics  may  be  determined  from  using 
real  test  data  by  analyzing  the  residuals  about  the  fit,  that  is, 
the  differences  between  the  filtered  data  values  and  the  nonfilt- 
ered  data  values.  A  statistical  analysis  may  be  made  for  the 
autocorrelation  and  for  the  amount  of  variance  or  standard 
deviation.  In  addition,  if  the  residual  distribution  includes  a 
randomness  about  zero,  this  randomness  is  a  good  indication  that 
the  systematic  error  because  of  improper  filtering  is  small.  If 
these  residuals  do  not  display  this  randomness  about  zero,  then 
the  filter  may  be  introducing  bias  or  systematic  error.  The 
feature  of  randomness,  however,  in  the  residual  analysis  is  only 
for  the  case  when  the  noise  is  uncorr e I ated .  Often  the  noise  is 
correlated.;  Then  the  residual  analysis  becomes  more  complicated 
and  must  be  undertaken  with  caution.  Spectral  analysis  may  be 
performed  on  the  residuals  as  defined  in  RCC  Document  153-71, 
Error  Analysis  and  Methods  For  Estimating  Errors  in  Position, 
Velocity,  and  Acceleration  Data. 
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CHAPTER  3 


FILTER  ANALYSIS  AND  DESIGN  IN  THE  FREQUENCY  DOMAIN 


3 . 1  Analyle  of  F I  I  ttr  Charaof  r  lo«  In  tha  Tlnr  Domain 

In  the  previous  chapter,  the  analysis  of  filter  characteris¬ 
tics  in  the  time  domain  was  considered.  Also  of  interest  are  the 
characteristics  of  the  filter  in  the  frequency  domain.  To  cite 
an  instance,  it  may  be  necessary  to  know  how  the  filter  treats 
different  frequencies  which  might  be  present  in  the  data  being 
filtered.  Probably  the  most  useful  tool  in  any  kind  of  analysis 
in  the  frequency  domain  is  the  Fourier  transform  as  defined  by 

00 

X(f)  =  J*  exp  I -2n  i  f  t)  X  ( t )  dt  (3-1) 

-00 

Here  x(t)  is  some  function  of  time,  f  is  frequency,  and  i  =  -1. 
The  function  X(f),  the  Fourier  transform  of  x(t),  gives  an 
indication  of  how  different  frequencies  are  distributed  in  the 
function  x(t).  To  transfer  from  the  frequency  domain  to  the  time 
domain,  use  the  inverse  Fourier  transform,  given  by 

00 

x(t)  =  J  exp { I 2ntf ) X ( f )df  (3-2) 

-00 


X(f)  and  x(t)  are  known  as  Fourier  transform  pairs. 


3 . 2  DIscrets  Fourier  Transform 


Because  the  digital  computer  requires  that  input  data  be  in 
sampled  form,  it  is  often  more  apppropriate  to  use  the  discrete 
version  of  the  Fourier  transform  given  by 


00 

X(T)  =  t  £  exp  I -2n I f J ) X ( j )  (3-3) 

J  =-00 


where  t  is  the  time  increment  at  which  samples  are  taken.  The 
variable  t  is  sometimes  referred  to  as  the  sampling  period.  Its 
reciprocal  is  sometimes  referred  to  as  the  sampling  frequency  or 
sampling  rate.  The  function  X(f)  is  known  as  the  discrete 
Fourier  transform  (OFT)  of  x(t).  For  a  finite  seouence 
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X  (0)  ,  X  ( 1  ) .  X  (N-  1) 


(3-4) 


the  aiscrete  Fourier  transform  is  given  by  the  sequence 
N-  1 

X(k)  =  £  exp ( -2n I k j /N)  •  t ( X  ( j ) )  k=0,  1,...,  N- I  (3-5) 

.1=0 

The  inverse  discrete  Fourier  transform  is  given  by 

N-  1 

XU)  (1/N)  E  exp(-27rikj/N) ‘tfxCj)  )  k  =  0,  1 .  N- I  (3-6) 

.1=0 

An  efficient  algorithm,  developed  by  J.  W.  Tukey  and  J.  W. 
Cooley  published  in  1965  and  commonly  used  to  calculate  the 
discrete  Fourier  transform,  is  the  Fast  Fourier  Transform  (FFT) . 
(A  paper  by  I.  J.  Good  a  decade  earlier  describes  a  very  similar 
algorithm.)  Essentially,  the  FFT  splits  the  sequence  into  two 
subsequences  with  each  containing  every  other  element  of  the 
original  sequence,  computes  the  discrete  Fourier  transforms  (DFT) 
of  those  sequences,  and  rearranges  the  values  of  their  DFTs  back 
in  their  proper  order  to  form  the  DFT  of  the  original  sequence. 

In  this  manner,  the  DFT  can  then  be  computed  by  using  fewer  com¬ 
plex  opeiations  (multiplications  and  additions). 

Norniaily,  the  subsequences  are  divided  again  in  the  same 
manner  as  the  original  sequence  to  further  reduce  the  number  of 
operation!.!  required  to  compute  the  DFT  of  the  original  sequence. 
The  subsequences  are  divided  still  further  until  there  are  only 
one-element  sequences.  When  this  subdividing  has  been  completed, 
the  ratio  of  the  number  of  operations  used  for  the  FFT  compared 
to  the  number  of  operations  used  to  calculate  the  DFT  directly  is 

log2N  (3-7) 

N 

where  N  is  the  order  (length)  of  the  original  sequence. 

It  IS  often  desirable  that  the  original  sequence  have  an 
order  equal  to  a  power  of  two,  so  it  can  be  divided  in  the  manner 
described  earlier.  In  the  event  that  the  original  sequence  is 
not  of  such  order,  the  sequence  is  often  padded  with  zeroes,  so 
that  it  can  be  completely  reduced.  The  extra  space  used  for 
padding  the  sequence  with  zeroes  is  more  than  compensated  for  by 
the  savings  afforded  by  the  algorithm.  Table  3-1  and  figure  3-1 
(obtained  from  references  47  and  53)  demonstrate  the  difference 
between  the  number  of  multiplications  used  when  calculating  the 
DFT  directly  and  that  used  when  applying  the  FFT.  See  reference 
52  for  a  brief  and  clear  explanation  of  the  Fast  Fourier  Trans¬ 
form. 
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TABLE  3-1,  COMPARISON  OF  REQUIRED  MULTIPLICATION  OPERATIONS 
USING  THE  FFT  AND  THE  DIRECT  DFT . 


N 

N^  (direct  DFT) 

2N  1092 

64 

4,096 

768 

128 

16,384 

1 ,792 

256 

65,536 

4,096 

512 

262, 144 

9,216 

1  ,024 

1 .048,576 

20,480 

Figure  3- 1 .  Compar i son  of  mu Itipiications  required  by 
direct  calculation  and  FFT  algorithm. 


3-3 


Another  useful  tool  in  the  analysis  of  a  f  i  I terS  frequency 
characteristics  is  the  power  spectral  density  function  (psd)  or 
power  spectrum.  This  function's  name  came  from  a  widely  used 
term  in  the  field  of  electrical  engineering  where  it  gives 
distribution  of  the  signal  power  for  each  frequenc/.  In  this 
case,  the  power  spectrum  is  measured  in  terms  of  watts  per  hertz. 
(In  electrical  engineering,  the  Fourier  transform  as  a  function 
of  time  IS  measured  in  hertz.  Hertz  is  cycles  per  second.)  The 
power  spectral  density  function  is  the  Fourier  transform  of  the 
autocorrelation  function,  which  is  defined  in  chapter  2.  In  the 
statistical  sense,  it  indicates  how  the  variance  is  distributed 
as  a  function  of  frequency.  For  the  discrete  case,  the  power 
spectral  density  function  of  ix{j)}  is  given  by  the  following  sum 


00 

G^(f)  =  £  exp  (-2n I f  ( j ) )  •  t (R ( j ) )  (3-8) 

J  =-00 

wnere  R{j).  the  autocorrelation  function,  is  given  by 

00 

R(j)  =  £  x(i)x(i-j)  (3-9) 

I  =-co 

One  of  the  best  ways  analyzing  a  filter’s  frequency 
properties  is  to  look  at  the  frequency  content  of  the  output  when 
the  input  IS  white  noise.  As  mentioned  in  chapter  1,  the  power 
spectral  density  of  white  noise  is  a  constant  for  all  frequen¬ 
cies.  Thus,  by  taking  the  power  spectral  density  of  the  output 
of  a  filter  whose  input  is  white  noise,  it  can  be  determined  how 
the  filter  treats  all  the  frequencies  in  the  data.  For  example, 
It  might  be  desired  that  the  filter  might  pass  frequencies  in  a 
band  f|  <  ^'^^2  ®  rejecting  alt  frequencies  outside  that  band. 

Then,  if  the  input  is  white  noise,  the  ideal  power  spectral 
density  nf  the  output  would  be  a  translated  rectangle  as  shown  in 
the  figure  3-2.  In  other  words,  if  the  psd  of  the  output  is  that 
shown  in  the  figure  3-2,  then  the  appropriate  frequencies  (those 
less  than  or  greater  than  f^)  were  filtered  out. 


Figure  3-2.  Power  spectrum  of  output,  where  the  input  is 
white  noise  and  where  the  f i I te'  passes  only 
the  frequencies  between  f^  and 
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An  indication  of  how  good  the  filter  is  can  be  seen  by  comparing 
the  power  spectral  density  of  the  filter  output,  when  the  input 
is  white  noise,  to  this  idealized  power  spectral  density. 

3.3  Tran»f«r  Funotlon  of  Flittr 

In  chapter  1,  it  was  noted  that  the  output  of  a  filter 
equals  the  input  convolved  with  the  filter  weighting  function.  A 
convolution  for  a  t  irne- i  nvar  i  ant  system  takes  the  form 

00 

y(t)  =  J  h(T)x(t-T)  dT  (3-10) 

-00 

where  h(T)  is  the  weighting  function. 

By  taking  the  Fourier  transform  of  the  above  equation,  the 
equation  becomes 

Y(f)  =  H(f)X(f )  (3-1 1) 

The  Fourier  transform  of  the  weighting  function,  H(f),  is  known 
as  the  transfer  function  of  the  filter  and  represents  the  ratio 
of  the  filter  output  to  the  filter  input  in  the  frequency  domain. 


Repeating  equation  (1-18),  the  equation  for  a  nonr ecurs i ve ,  time- 
invariant  digital  filter  is 

y(n  =  E  h(fc)x(j-k)  (3-12) 

k 

The  transfer  function  H(f)  for  this  filter  is  given  by 

H(t)  =  E  h  (k )  exp  ( -2rc  i  f  k) 'A  t  (3-13) 

k 

Likewise,  we  repeat  equation  (1-19),  the  equation  for  a  recursive 
t ime- 1 nvar I  ant  digital  filter: 

N  M 

E  alk)x(j-k)  +  E  b(k)y(j-k) 
k=0  k=) 


y  ( .1  ) 


(3-14) 


The  transfer  function  H(f)  for  this  filter  is  given  by 


N 

£  a (k) exp (-2n i fk) 
k:=0 

H(f)  =  _ _  (3-15) 

M 

1  +  £  b (k ) exp {-2n i fk) 

k=  1 

The  modulus  of  the  transfer  function  is  called  the  gain  of  the 
filter  and  represents  the  amplification  of  the  input. 

Filters  can  be  categorized  according  to  the  characteristics 
of  their  transfer  functions.  A  filter  is  called  an  ideal  I  ow- 
pass  f i  I  ter  i f 

!1  for  0  <  I  f  j  <  f.. 

(3-16) 

0  for  <  I  f  I 

The  plot  of  I  H(f)  I  is  as  shown  in  figure  3-3. 


Figure  3-3.  (deal  low-pass  filter. 


A  filter  IS  called  an  ideal  high-pass  filter  if  the  transfer 
function  IS  given  by 

!0  for  0  <  I  f  I  <  fu 

”  (3-17) 

1  for  f^  <  I  f  I 

and  the  plot  of  lH(f)  I  is  as  shown  in  figure  3-4. 
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1  H(f)l 


-f. 


rigure  3-4.  Ideal  high-pass  filter 

A  filter  is  called  an  ideal  band-pass  filter  if 

0  for  0  <  1  f  1  <  f^ 


I  H(f)  I  = 


1  for  f|^  <  i  f  1  5.  ^|_ 


1  0  for  fL  <  1  H 

and  the  plot  is  as  shown  in  figure  3-5. 


Figure  3-5.  Ideal  band-pass  filter 


(3-18) 
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These  ideal  filters  cannot  be  attained  because  there  is,  in 
practice,  a  finite  number  of  samples.  The  impulse  response  in 
equation  (3-10)  is  multiplied  by  a  "boxcar"  or  window  function 
which  covers  the  time  interval  being  sampled.  Alternatively,  the 
limits  of  integration  can  be  changed  to  the  appropriate,  finite 
time  limits.  An  stated  in  paragraph  1.5,  the  transform  of  the 
product  of  two  functions  is  the  convolution  of  the  transforms  of 
the  two  functions.  Now  the  transform  of  the  boxcar  function  is  a 
sine  function.  (By  definition,  sine  x  =  sin  (nx)/nx.)  The 
resulting  transfer  function  is  the  sine  function  convolved  with 
the  transfer  function  of  an  ideal  filter.  The  graph  of  the 
resulting  gain  is  a  boxcar  function  with  ripples  and  not  the 
ideal  boxcar  function  illustrated  in  this  section. 

Methods  for  simulating  the  ideal  low-pass  filter  are  given 
in  chapter  6.  High-pass,  band-pass,  and  band-rejection  filters 
(discussed  in  chapter  4)  are  normally  derived  by  first  designing 
a  low-pass  filter.  Methods  for  obtaining  all  of  these  fitters 
are  given  in  chapter  4. 

3.4  Cutoff  Prequenov.  Roll-Off,  and  Quel  tty  of  Filter 

in  the  previous  section,  a  low-pass  filter  was  defined  in 
terms  of  a  frequency  denoted  as  f^j.  This  frequency  fg  is  called 
the  cutoff  frequency  (see  equation  3-16).  The  cutoff  frequency 
is  used  as  a  criterion  for  designing  digital  filters  In  the 
frequency  domain.  It  also  gives  a  standard  for  analyzing  the 
performance  of  filters  in  the  frequency  domain. 

As  explained  in  paragraph  3.3,  ideal  filters  are  simulated 
and  not  used  directly.  The  simulating  filters  do  not  have  gains 
that  look  like  the  boxcar  functions  drawn  in  paragraph  3.3.  The 
gain  of  a  simulating  f  i  ‘ ter  does  not  suddenly  drop  off  from  1  to 
0  the  way  the  gain  of  an  ideal  filter  does.  Instead,  it  normally 
starts  off  (at  f=0}  with  a  value  that  is  within  a  predetermined 
tolerance  6^  of  1  and  tapers  off  to  within  a  predetermined  toler¬ 
ance  ^2  of  0. 

The  band  of  frequencies  in  which  the  gain  is  between  1~<5i 
and  1+6^  is  called  the  passband .  The  greatest  frequency  value  in 
the  passband  is  the  cutoff  frequency  for  the  passband.  The  band 
of  frequencies  in  which  the  gain  is  <62  is  called  the  stopband. 
The  lowest  frequency  value  for  the  stopband  is  the  cutoff  fre¬ 
quency  for  the  stopband.  The  band  in  which  the  gain  is  <  1-<5^ 
and  >62  IS  called  the  transition  band.  These  items  are  illus¬ 
trated  in  figure  3-6,  which  is  obtained  from  reference  56. 

One  commonly  used  simulation  to  the  ideal  low-pass  filter 
that  is  not  designed  on  the  basis  of  a  transition  band  and  two 
cutoff  frequencies  is  the  Butterworth  filter.  This  filter  and 
other  simulations  are  given  and  explained  in  chapter  5. 
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Figure  3-6.  Tolerance  I imite  for  opprox imat i on 
of  ideal  low-pass  filter. 


Another  important  concept  in  the  analysis  is  the  roll-off. 
This  quantity  indicates  to  what  extent  the  slope  of  the  transfer 
function  of  a  simulating  (nonideal)  filter  (see  paragraph  3.3) 
approaches  the  90*  slope  of  the  transfer  function  of  the  ideal 
filter.  Roll-off  is  related  to  the  intuitive  notion  of  "sharp¬ 
ness"  of  the  cutoff.  This  quantity  is  defined  as 

-f  d  I  H  i 

p  =  -  -  (3-19) 

H  df 

A  value  for  p  can  be  obtained  at  any  frequency  desired.  For 
purposes  of  comparison  and  ana  lysis  of  filters,  this  quantity  is 
often  calculated  at  I  H  I  =1/  fz.  In  figure  3-7,  the  plots  of 
I  H(f)l  for  two  filters,  A  and  B,  which  approximate  the  ideal 
low-pass  filter  are  given.  Both  filters  have  the  same  cutoff 
frequency,  but  A  has  a  higher  rolloff  than  B. 


Figure  3-7.  Comparison  of  rolloffs  for  filters  A  and  B, 


A  third  concept  used  in  analyzing  low-pass  filters  in  tha 
frequency  domain  is  quality,  which  is  defined  as  the  extent  to 
which  the  filter  attenuates  frequencies  well  above  the  cutoff 
frequency.  (An  attenuating  function  in  the  frequency  domain  is 
one  that  approaches  zero  as  the  frequency  increases.)  There  is 
no  standard  mathematical  definition  for  quality,  so  some  subjec¬ 
tive  judgment  must  be  used  to  determine  the  quality  of  a  filter. 
One  tool  that  can  be  used  in  making  this  Judgment  would  be  the 
power  spectral  density  function  as  discussed  in  paragraph  3.2. 

For  example,  if  two  filters,  A  and  B,  yield  the  power  spectral 
density  functions  shown  in  figure  3-8,  then  it  might  be  concluded 
that  filter  A  has  the  better  quality. 


Figure  3-8.  Comparison  of  the  quality  of  filter  A 
with  the  quality  of  filter  B. 
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3.5  Phw  Shift  of  Fllfr 


The  transfer  function  H(f)  of  a  filter  is  generally  a 
complex  number  and  can  be  expressed  as 

H(f)  =  I  H(f)  1  exp(i0{f))  (3-20) 

0(f)  is  called  the  phase  snift  of  the  filter.  Alternate  names 
are  phase  response  and  phase  angle.  A  time  shift  in  the  time 
domain  corresponds  to  a  phase  shift  in  the  frequency  domain. 

Equation  (3-20)  can  be  expressed  as 

H(f)  =  1  H(f)  I  cos(e(f))  +  i  H(f)  sin(e(f))  (3-21) 

or 

H(f)  =Re(H(f))  +  i.|m(H(f))  (3-22) 

where 

Re(H(f))  =  1  H(f)  I  cos(0(f)  and  lm(H(f))  =  i  H(f)  I  sin 
(0(f)).  Re  and  Im  denote  real  and  imaginary  parts  of  a  complex 
number . 

^  =  tan(0(f))  (3-23) 

Re(H(f) ) 

The  phase  shift  of  the  filter  is  then 

0(f)  =  arctan  *n?LHtf) ),  (3-24) 

Re(H(f) ) 

The  output  of  the  filter  Is  in  phase  with  the  input  only  if 
lm(H(f))  =  0.  In  most  applications,  this  phase  shift  is  impor¬ 
tant,  and  the  analyst  should  be  aware  of  its  magnitude. 

3 . 6  Conatructlon  of  Flltar  Walghts 

Again  consider  a  linear,  nonrecursive  digital  filter  whose 
defining  equation  is 


M 

y(k)  =  I  h(j)x(k-j)  (3-25) 

j=o 

In  this  section,  a  general  discussion  of  the  way  the  {h(j))  are 
determined  will  be  given  so  that  the  filter  will  have  a  desired 
frequency  response  function.  The  frequency  response  is  the  same 
as  the  transfer  f  motion  except  that  it  is  applied  to  a  specific 
class  of  inputs  in  the  form 


3-1  1 


X  ( n ) 


exD ( I 2n  f n ) . 


(3-26) 


One  way  of  approaching  this  problem  is  to  assume  a  desired 
frequency  response  function,  H(to),  then  take  the  inverse  Fourier 
transform  to  get  h(t)  as  shown  in  equation  (3-27).  The  variable 
IS  the  angular  frequency  and  is  equal  to  2nf . 

CO 

h(t)  =  _J|_  J  exp(  i  tt  t)H(  0  )  dtt  (3-27) 

2n  -00 

The  weights  for  the  discrete  filter  are  then  oetermined  by 
evaluating  this  continuous  weighting  function  at  soecific  in¬ 
stants  in  time, 

h^  =  h(tr,)At.  (3-28) 

There  are  problems  with  constructing  these  weights  if  the  ideal 
frequency  response  is  used.  For  example,  the  idea'  frequency 
response  for  the  low-pass  filter  is  the  unit  rectangle  as  given 
in  figure  3-3.  The  inverse  Fourier  transform  must  be  truncated 
in  the  applied  case,  so  only  a  finite  number  of  weights  are  used 
in  equation  (3-25).  The  truncated  Fourier  transform  of  the  unit 
rectangle  is  very  "bumpy"  (see  paragraph  3.3,  page  3-7)  because 
of  the  discontinuity  at  f^,  and  is  not  useful  in  most  applica- 
t  i  ons . 

Approaches  to  avoiding  this  d  i  I  errma  are  given  in  references 
7,  11,  and  13.  In  reference  7,  Gennery  eliminates  the  d i I ema  by 

using  various  modifications  of  the  Gaussian  distribution  function 
for  the  Ideal  response  function.  In  reference  11,  Ormsby  replac¬ 
es  the  ideal  frequency  response  function  with  a  function  having  a 
finite  slope.  In  reference  13,  Stirton  multiplies  the  h(t)  for 
the  ideal  filter  by  certain  "apod i z i ng"  functions  which  eliminate 
the  bumps  in  the  frequency  response  function. 

In  certain  applications,  the  z-transform  rather  than  the 
Fourier  transform  is  used  for  designing  filters  in  the  frequency 
domain.  The  z  in  the  z-transform  is  often  used  as  a  replacement 
for  the  exponential  function  in  the  discrete  Fourier  transform 
(DFT).  It  is  used  as  such  for  computational  ease  and  to  facili¬ 
tate  transfer  function  analysis.  For  example,  it  is  easier  to 
determine  stability  of  a  filter  by  looking  at  the  z-tranSform 
rather  than  by  looking  at  the  DFT.  Determining  filter  stability 
in  this  manner  will  be  discussed  again  in  paragraph  3.8  and  in 
chapter  5. 

The  z-transform  approach  is  used  when  the  transfer  function 
of  an  analog  filter  is  known,  and  when  construction  of  a  digital 
filter  having  that  same  transfer  function  is  desired.  The 
z-transform  of  an  analog  function  f(t)  is  defined  as 
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(f  U)  ) 


£  f  (  nT )  2~  ' 
n=0 


(3-29) 


It  can  be  shown  that  the  z-transform  of  the  weighting  function  is 
the  ratio  of  two  polynomials  in  the  form 

N 

I  a(n)z"'  (3-30) 

n=0 

H(2)  =  - 

M 

1  +  £  b  ( n)  z  ' 
n=  1 


if  the  filtered  output  (yfk))  is  given  by  the  recursive  relation 


N  M 

y(k)  =  £  a(n)x(k-n)  +  £  b(n)y(k-n) 

n=0  n=1 


(3-31 ) 


It  can  also  be  shown  that  the  z-transform  of  the  weighting 
function  is  in  the  form 

N 

H(2)  =  £  a(n)2"'  (3-32) 

n  =  0 


if  the  filtered  output  {y(k)}  is  given  by  the  nonrecursive 
relation 


N 

y(k)  =  £  s(n)x(k-n)  (3-33) 

n=0 


Other  ways  in  which  H(z)  can  be  expressed  are  discussed  in 
chapter  5. 

3 . 7  A I  i as i ng 

In  performing  with  digital  filters,  samples  are  taken  from 
an  analog  sinusoidal  waveform,  and  the  wavefonr  is  reconstructed 
from  the  samples.  The  samples  are  typically  taken  at  equal¬ 
spaced  time  intervals.  The  problem  arises  about  how  short  these 
sampling  intervals  should  be  so  that  the  original  analog  waveform 
can  be  exactly  reconstructed.  If  the  samp  I  i ng  intervals  are  too 
large,  that  is,  if  the  samples  are  too  infrequent,  the  original 
analog  waveform  may  be  reconstructed  to  have  a  lower  frequency 
than  it  actually  has.  This  misrepresentation  of  a  frequency  by  a 
lower  frequency  is  known  as  aliasing. 


The  appearance  of  wheel  spokes  turning  slower  than  they 
actually  are  is  an  example  of  aliasing.  The  alternate  term 
"foldover"  can  be  expressed  by  the  next  example.  Suppose  an 
observer  is  taking  visual  samples  at  a  constant  time  rate  of  the 
fast-turning  wheel  spokes.  As  the  wheel’s  rotational  speed 
increases,  the  wheel  spokes  seem  to  be  rotating  faster  up  to  a 
certain  point.  Then  the  wheel  spokes  appear  to  slow  down  until 
they  seemingly  rotate  faster  and  faster  in  the  backward  direction 
up  to  a  certain  point.  The  spokes  then  seemingly  slow  down  until 
it  looks  as  though  they  are  going  in  a  forward  direction.  If  the 
observed  rotational  motion  is  placed  on  a  plot  of  observed 
frequency  versus  actual  frequency,  the  graph  "folds  over"  at  a 
frequency  value  known  as  the  Nyquist  or  folding  frequency  (see 
figure  3-9).  The  axis  represents  the  observed  frequency  while 
the  fg  axis  represents  the  actual  frequency,  and  the  value  fjj  is 
the  Nyquist  frequency. 


Figure  3-9.  Foldover  or  aliasing  resulting  from  observing 
a  wheel's  increasing  rotational  speed. 


3.7.1  Al las  I  no  In  the  Time  Domain 

An  illustration  of  aliasing  in  the  time  domain  is  given  in 
figure  3-10.  The  original  analog  waveform  is  the  thinner  sinu¬ 
soid  and  is  sampled  at  the  points  shown.  With  these  sampled 
points,  the  original  waveform  is  reconstructed  so  that  the  result 
is  the  thicker  line  which,  of  course,  has  a  lower  frequency  than 
the  original  waveform.  In  producing  new  waveform,  the  original 
one  was  m i sreconstructed  because  the  samples  were  taken  too 
infrequently  (see  figure  3-10). 
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Figure  3-10.  Aliasing  in  the  time  domain. 


More  often  than  not,  the  original  waveform  represents  the 
sum  of  many  sine  and  cosine  functions.  Figure  3-1),  obtained 
from  reference  62,  illustrates  this  notion.  The  bottom  sinusoid 
IS  the  sum  of  the  top  three  sinusoids.  The  frequency  of  each  of 
the  top  three  sinusoids  is  cal  led  a  "frequency  component"  of  the 
bottom  sinusoid. 


Figure  3-11.  Bottom  sinusoid  shown  as  the  =um  of  three 
frequency  components,  C2,  Cl.  and  Si. 


3.7.2  Allaalno  In  th«  Friqutnov  Domiln 

The  discrete  Fourier  transform  of  a  signal  can  be  expressed 
in  terms  of  the  analog  Fourier  transform  by 


00 

X(e'®^)  =  (1/T)  I  Xa(0  +  (2n/T)m)  (3-34) 

m=-oo 

where  ( )  (in  the  right-hand  side)  is  the  analog  Fourier  trans¬ 
form,  nnd  X{)  (in  the  left-hand  side)  is  the  discrete  Fourier 
transform.  This  equation  is  derived  in  reference  55. 


The  frequency  interval  of  each  term  in  the  summation  sign  of 
equation  (3-34)  will  not  intersect  with  its  adjacent  interval  if 
it  is  at  most  2jt/T  wide.  Figure  3-12,  obtained  from  Reference 
54,  point  to  this  fact.  Figure  3-12  illustrates  the  analog 
Fourier  transform  of  one  of  the  terms,  which  covers  a  frequency 
bandwidth  of  2n/T  and  illustrates  the  infinite  sum  of  such  terms. 
As  can  be  seen,  2n/T  is  the  widest  that  these  terms  can  be 
without  intersecting  each  other. 


Figure  3-12.  Sampling  relations  for  analog  and  digital 
systems  for  properly  sampled  incuts. 
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Figure  3-13,  obtained  from  reference  54,  gives  an  example 
where  samples  are  taken  too  infrequently,  in  particular,  where 
they  are  taken  at  a  rate  of  w/3n,  which  is  less  than  w/27t.  In 
other  words,  the  frequency  bandwidth  for  each  term,  which  is 
3n/T,  is  greater  than  2n/T.  Figure  3-13a  shows  the  graph  of  one 
of  the  terms  in  the  summation  of  equation  (3-34),  when  substitut¬ 
ing  3n/T  for  w.  Figure  3-13b  explains  how  the  adjacent  terms 
overlap  each  other,  and  figure  3-12c  displays  the  resulting  graph 
of  the  Fourier  transform.  It  is  easily  seen  how  the  frequency 
3n/2T  can  be  mistaken  for  the  frequency  n/2T.  This  phenomenon, 
where  in  effect  a  frequency  component  takes  on  the  identity  of  a 
lower  frequency,  is  aliasing  or  foldover. 


Figure  3-13.  The  effects  of  undersamp I i ng  on  the  digital 
frequency  response. 

3.7.3  Sampling  Theorem  and  the  Nyqulst  Frequency 

The  Sampling  Theorem  offers  a  way  to  avoid  aliasing.  It 
states  that  if  the  Fourier  transform  of  a  signal  is  bandlimited, 
then  the  original  signal  can  be  exactly  reconstructed  if  samples 
are  taken  at  a  frequency  of  at  least  twice  that  of  the  highest 
frequency  component  in  the  signal .  In  mathematical  terms,  the 
Sampling  Theorem  states  if  F (tt) ,  the  Fourier  transform  of  a 
periodic  time  function  f(t),  is  bandlimited  so  that 

F(«)  =  0  for  I  tt  I  >  «^  "  2nf|^)  (3-35) 
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then  f(t)  can  be  uniquely  determined  if  it  is  sampled  at  inter¬ 
vals  no  greater  than  1/2f^=  that  is,  at  a  sampling  rate  of 

no  less  than  2fjj  = 

Figures  3-11  and  3-12  imply  the  va I idity  of  this  theorem. 
From  these  figures,  it  can  be  seen  that  the  frequency  should 
be  at  most  n/T  to  avoid  foldove*.  In  other  words,  the  sampling 
rate  1/T  should  be  no  less  than  O^/n. 

For  samples  f^  which  equals  f(t^),  where  t^^  <  n/2f^  =  nn/®^, 
then  the  original  analog  signal  f(t)  can  be  reproduced  by 

f(t)  =  CO  f  sin(<»-t  -  nn)  (3-36) 

n  n  c 


n=-co  Opt  -  nn 

2fj,  is  known  as  the  Nyquist  or  folding  frequency.  (This  theorem 
is  stated  and  elegantly  proven  in  subparagraph  9.1.1  of  reference 
47. ) 


3 • 8  Stab  1 1  I  tv  of  F I  I  ter 

A  digital  filter  is  stable  if  every  bounded  input  sequence 
yields  a  bounded  output  sequence  through  this  filter.  A  sequence 
is  bounded  if  all  its  terms  are  less  than  a  specific  positive 
integer.  It  can  be  shown  that  a  necessary  and  sufficient  condi¬ 
tion  for  stability  is  that  the  impulse  response  I  h(k)  t  be  such 
that 


00 

I  I  h(k)  1  <  00  (3-37) 

k  =  -oo 

From  this  condition,  it  can  be  shown  that  another  indication  of 
filter  stability  is  that  all  the  poles  of  the  transfer  function 
be  inside  the  unit  circle  in  the  (complex)  z  plane.  If  poles  are 
on  the  unit  circle,  then  the  filter  may  or  may  not  be  stable.  if 
a  pole  is  outside  the  unit  circle,  the  filter  is  not  stable.  See 
chapter  5  for  the  relation  between  pole  location  and  filter 
stab i I i ty . 
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CHAPTiR  4 


CATEGORIES  OF  DIGITAL  FILTERS 


In  Chapter  1,  some  of  the  fundamental  principles  of  digital 
filters  were  discussed.  As  stated  earlier,  the  basic  reason  for 
using  a  digital  filter  is  to  separate  or  suppress  errors  and  to 
pass  signals  without  significant  distortion.  As  discussed  in 
Chapter  3,  the  frequency  response  of  the  filter  should  be  such 
that  those  frequencies  consisting  mainly  of  the  desired  signal 
should  be  passed  through  the  filter,  and  those  frequencies 
consisting  mainly  of  noise  (error)  should  be  rejected.  If  the 
complete  statistical  characteristics  of  the  signal  and  noise  are 
known,  then  using  the  principles  discussed  in  chapter  3,  a  filter 
can  be  constructed  to  separate  signal  from  noise  in  an  optimum 
manner . 

1  Low-Pass  Dig  Its!  Filters 

The  data  from  missile  trajectory  work  usually  contains  a 
signal  which  consists  mainly  of  large  low-frequency  components. 
The  noise  error  is  usually  assumed  distributed  throughout  the 
frequency  spectrum  with  the  desired  signal  being  much  greater  in 
amplitude  than  the  noise  at  low  frequencies  but  smaller  than  the 
amplitude  of  the  noise  at  the  high  frequencies.  In  this  case,  a 
low-pass  filter  is  designed  to  pass  the  desired  signal. 

A  low-pass  filter  has  a  frequency  response  of  exact  unity  at 
zero  frequency,  approximate  unity  at  low  frequencies,  and  approx¬ 
imately  zero  at  higher  frequencies  (see  figure  4-1).  The  low- 
pass  filter  Is  simulated  by  the  idea  I  low-pass  filter  defined  in 
paragraph  3.3).  Tl.  frequency  at  which  the  transition  occurs 
between  the  high  anu  low  frequencies  Is  called  the  cutoff  fre¬ 
quency  (fg)  of  the  filter.  Because  a  low-pass  filter  removes  the 
high  frequency  fluctuations  from  the  data,  it  is  often  referred 
to  as  smoothing  the  data. 
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Figure  4-1.  Typical  frequency  response  of  Vow-pass 

filter  (represented  by  the  curved  line). 


4 . 2  High-Pass  Digital  Filters 

The  category  of  low-pass  filters  discussed  in  the  previous 
section  can  be  transformed  into  filters  which  perform  other 
tasks.  In  analysis  work,  one  of  the  most  commonly  used  is  the 
high-pass  filter.  As  the  name  implies,  a  high-pass  filter  is 
designed  to  pass  high  frequencies  and  reject  the  low  frequencies. 
A  low-pass  filter  can  be  transformed  into  a  high-pass  filter  in 
several  conceptually  equivalent  ways.  One  of  the  most  common 
ways  is  to  subtract  its  frequency  response  from  unity  at  all 
frequencies.  That  is,  if  H|_(f)  is  the  frequency  response  of  a 
low-pass  filter,  then 

H^Cf)  =  1  -  H^Cf)  (4-1) 

defines  the  frequency  response  of  a  high-pass  filter. 

S  i  nee 


H|_{0)  =  1  (4-2) 

fer  a  low-pass  filter,  then  it  follows  that 

H,^(0)  =  0  (4-3) 

Equation  (4-1)  shows  that  output  from  a  high-pass  filter  is 
the  same  as  the  difference  between  the  unfiltered  data,  that  is, 
output  from  an  "all-pass"  filter  and  the  output  from  a  low-pass 
filter.  Clearly,  since  a  filter  whose  response  is  unity  over  all 
frequency  bands,  an  all-pass  filter  passes  the  data  without 
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change;  that  is,  it  does  not  filter  the  data  at  all.  Therefore, 
the  effects  of  a  high-pass  filter  can  be  duplicated  by  filtering 
the  raw  data  with  a  low-pass  filter  and  then  subtracting  the 
results  from  the  raw  data  as  in 


Y  =  H^X  =  (1-Hl)X  =  X  -  HlX  (4-4) 

X  is  the  raw  data  (in  the  frequency  domain).  H^X  is  the  low-pass 
filtered  data.  This  technique  is  often  used  in  analysis  of  high- 
frequency  noise  on  missile  trajectory  data;  however,  the  proce¬ 
dure  of  subtracting  the  low-pass  or  smoothed  data  from  the  raw 
data  can  be  cumbersome  and  time  consuming.  A  generally  faster 
approach  is  to  construct  the  weights  of  the  high-pass  filter  and 
apply  them  directly  to  the  raw  data. 


The  weights  for  this  high-pass  filter  can  be  obtained  by 
taking  the  difference  between  the  weights  for  the  two  filters 
given  by  the  right-hand  side  of  equation  (4-1).  Remember  from 
paragraph  2.3  that  these  weights  amount  to  the  unit  impulse 
responses  of  their  respective  filters.  For  an  all-pass  filter, 
the  response  to  a  unit  impulse  is  a  unit  impulse,  because  the 
input  data  is  left  unchanged  by  this  filter.  Consequently,  all 
the  weights  of  an  all-pac...  f  '  1  ter  are  unit  impulse  responses. 

The  weights  for  the  low-pass  filter  are  then  subtracted  from  the 
weights  of  the  all-pass  filter  to  obtain  the  weights  for  the 
high-pass  filter.  Letting  represent  the  weights  for  a 

low-pass  filter  and  represent  the  weights  for  the  corre¬ 

sponding  high-pass  filter,  then 


W 


H,k 


^k 


W 


L,k 


where 


I  ,  if  .  =  0 
*  0  i  f  k  #  0. 


(4-5) 


(4-6) 


4.3  Band-Pass  F I  I  tars 


The  band-pass  filter  passes  a  set  of  adjacent  frequencies 
while  rejecting  the  frequencies  above  and  below  the  set  of 
frequencies.  A  band-pass  fitter  is  said  to  be  narrow  if  the 
frequency  band  contains  very  few  frequencies,  and  wide  if  it 
contains  many  frequencies.  If  the  desired  frequency  bandwidth  is 
large  compared  to  the  center  frequency  of  the  band,  a  wide 
band-pass  filter  would  be  desirable  to  use  for  filtering  the 
band.  If  the  bandwidth  is  small  compared  to  the  center  frequen¬ 
cy,  it  would  be  better  to  filter  it  with  a  narrow  band-pass 
f i I  ter  . 
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The  wide  band-pass  filter  is  constructed  by  combining  a 
high-pass  filter  with  a  low-pass  filter.  The  high-pass  filter, 
used  for  this  construction,  has  a  cutoff  frequency  f^  in  the  area 
of  the  spectrum  where  the  low-pass  frequency  resportse  is  approxi¬ 
mately  unity.  The  low-pass  filter  that  is  used  has  a  cutoff 
frequency  f^  where  the  frequency  response  of  the  high-pass 
H 

filter  is  approximately  unity.  There  is  a  resulting  band  of 
frequencies  where  the  low-pass  and  high-pass  filters  are  both 
unity,  so  that  f^,  >  '^c  *  frequency  response  of  the 

L  H 

res'ulting  filter  would  have  a  low  end  of  f_  ,  a  high  end  of 

H 

fp  and  a  center  frequency  of 
L 


fp  +  fj,  (see  figure  4-2). 


(4-7) 


I  H  (  f )  I  filter  gain 


Figure  4-2.  Frequency  response  of  wide  band-pass  filter. 


To  perform  the  band-pass  filtering,  the  high-pass  and 
low-pass  filters  can  be  applied  separately  to  the  data  in  series, 
which  is  usually  time  consuming.  It  is  more  desirable  to  combine 
the  two  filters  into  a  single  band-pass  filter  by  convolving  the 
weights  of  the  two  filters  with  the  input  data  in  the  time 
domain.  The  same  resuits  can  be  obtained  by  multiplying  the 
frequency  response  of  each  filter  with  the  Fourier  transform  of 
the  input  data  in  the  frequency  domain  and  then  talcing  the 
inverse  Fourier  Transform  to  get  the  band-pass  filtered  data  in 
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the  time  domain.  The  methods  mentioned  here  are  essentiaily  the 
same  as  the  methods  described  in  paragraph  4.2  for  converting  a 
low-pass  filter  Into  a  high-pass  filter. 

If  the  frequency  response  curves  of  the  high-pass  and 
low-pass  filters  are  sharp  and  closely  approximate  the  ideal 
frequency  response  of  a  step  function,  the  techniques  discussed 
previously  will  work  for  a  narrow  band-pass  filter.;  If  this  is 
not  the  case  and  the  roll-off  Is  not  steep,  a  narrow  band-pass 
filter  can  be  constructed  using  the  following  technique.  The 
frequency  response  of  a  low-pass  filter  is  translated  so  that  the 
center  frequency  of  the  low-pass  filter,  f=0,  is  moved  to  the 
desired  center  frequency  of  the  passband  with  its  own  mirror 
image  reflected  about  the  zero  frequency,  thus  its  mirror  image 
is  at  the  corresponding  negative  frequencies  (see  figure  4-3). 


Figure  4-3.  Method  of  converting  a  low-pass  filter  with 
shallow  roll-off  into  a  band-pass  filter. 


4.4  Bend-Rejeot Ion  Filters 

To  remove  a  particular  band  of  frequencies  from  the  data 
and,  at  the  same  time,  to  preserve  the  lower  and  higher  frequen¬ 
cies,  a  band-rejection  filter  can  be  constructed.  The  band- 
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rejection  filter  is  the  opposite  of  the  band-pass  filter.  Tnere 
are  various  methods  of  constructing  a  band-rejection  filter  from 
a  band-pass  filter.  Each  method  Is  analogous  to  an  approach 
discussed  in  paragraph  4.2  In  obtaining  a  high-pass  filter  from  a 
I ow-pass  f i I  ter . 

The  frequency  response  of  the  band-rejection  filter  can  be 
obtained  by  subtracting  the  band-pass  response  from  unity  as 
shown  in  figure  4-4.  In  the  time  domain,  the  band-rejection 
results  can  be  obtained  by  band-pass  filtering  and  then  subtract¬ 
ing  the  band  pass-filter  results  from  the  raw  data. 


Another  approach  is  to  construct  band-rejection  weights  and 
then  filter  the  data  directly  in  a  one-step  operation.  The 
weights  are  constructed  by 


W, 


R.k 


=  <5^  - 


B,k 


(4-8) 


where 


Wb  k  band-pass  weights 


(4-9) 


and 


i  f  k  =  0 
i  f  k  0 


(4-10) 


Filtering  can  be  accomplished  by  convolving  the  weights  of  the 
band-r e j ec t i on  filter  with  the  input  data  to  obtain  the  filter. 


Figure  4-4.  Frequency  response  of  band-rejection  filter. 
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4.B  Phtta>-Shl  ft  FI  I  fra 


All  categories  of  digital  filters  have  a  phase-shift  curve 
which  characterizes  the  amount  of  phase  shift  the  filter  induces 
for  each  frequency.  It  is  sometimes  desirable  to  construct  a 
filter  which  will  shift  the  phase  of  a  signal  py  a  constant 
amount  over  a  narrow  band  of  frequencies  while  maintaining 
constant  amplitude.  For  example,  a  sinusoidal  signal  with 
amplitude  «  and  phase  0  can  be  resolved  into  two  components  with 
amplitude  k  cos  0  and  phase  0*  and  amplitude  «  sin  0  and  phase 
90®.  In  this  case,  a  filter  is  constructed  which  produces  a 
phase  shift  of  90"  and  combines  the  output  of  the  filter  with  the 
unshifted  data  in  the  appropriate  manner  to  produce  any  desired 
resultant  phase  shift.  A  phase  lead  of  90®  and  no  amplitude 
change  corresponds  to  frequency  response  equal  to  V  - 1 .  An  ideal 
d i g  i  ta I -phase  shifter  maintains  this  value  for  all  frequencies 
between  zero  and  the  Nyquist  frequency. 

4.6  Flltsr  Combinations 


Any  or  ail  of  the  filters  discussed  in  this  chapter  can  be 
combined  to  form  filters  which  perform  more  complex  tasks.  In 
any  case,  whatever  effects  are  wanted  can  be  accomplished  in  the 
time  domain  by  applying  the  filters  independently  in  series  or  by 
getting  a  one-step  complex  filter  by  convolving  the  filter 
weights  together  in  the  time  domain.  On  the  other  hand  in  the 
frequency  domain,  the  frequency  response  curves  can  be  multi¬ 
plied,  added,  or  subtracted  to  give  whatever  response  is  desired, 
then  transformed  to  the  time  domain  via  the  appropriate  use  of 
the  inverse  Fourier  transformation. 

One  special  combination  filter  is  referred  to  as  a  "comb 
filter."  This  filter  consists  of  a  series  of  n  narrow  band-pass 
filters  having  a  frequency  response  curve  with  n  narrow  frequency 
bands  at  equai  spaces  between  zero  and  the  Nyquist  frequency, 
which  was  discussed  in  subparagraph  3.7.3.  This  type  of  filter 
is  constructed  by  convolving  the  raw  data  with  the  weights  of  n 
narrow  band-pass  filters  that  can  be  accomplished  in  a  one-step 
operation.  (A  similar  one-step  operation  is  discussed  in  para¬ 
graph  4.4,  in  converting  a  band-pass  filter  into  a  band-rejection 
filter.)  The  filter  is  then  usually  used  to  aid  in  determining 
significant  frequencies  and  cut-off  levels  for  other  low-pass  or 
high-pass  filters.  The  Fast  Fourier  Transform  is  usually  consid¬ 
ered  a  oetter  tool  for  this  analysis  than  the  comb  filter. 
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CHAPTER  B 


FREQUENCY  DOMAIN  FILTER  DESIGN 


There  have  been  many  filters  developed  for  digital  signal 
processing  in  the  frequency  domain  and  various  ways  to  express 
these  filters.  In  this  chapter,  a  synopsis  of  the  filters  is 
given  along  with  their  various  modes  of  expression.  For  recurs¬ 
ive  filters,  methods  of  conversion  from  the  analog  form  to  the 
digital  form  are  given  as  well.  Also  discussed  are  the  advantag¬ 
es  and  disadvantages  of  using  each  type  of  filter,  mode  of 
expression,  and  method  of  conversion.  Since  the  approach  to 
designing  infinite  impulse  response  (IIR)  (recursive)  and  finite 
impulse  response  (FIR)  (nonrecursive)  filters,  described  earlier 
in  this  document,  ate  completely  different,  the  chapter  is 
divided  into  two  parts:  IIR  and  FIR  filter  design. 

5 . 1  Inf  In  I ta  Impulaa  Reaponaa  (IIR)  Filter  Design 

The  MR  filters  have  been  extensively  analyzed  in  the  analog 
form.  Consequently,  digital  MR  filters  are  usually  described 
first  in  analog  form  and  then  converted  to  digital  form. 

The  problem  of  approximating  an  MR  filter  involves  a 
complex  transfer  function  of  the  frequency  O.  The  transfer 
function  can  be  written  as 

H(2)  =1  H(2)  1  ,  (5-1) 

Where  2=e'®,  and  B(2)=B(e'®)  is  the  phase  angle,  which  can  be 
de  f i ned  as 

lm(H(e'®) ) 

B(e'®)  =  arc  tan  - ; - .  (5-2) 

Re(H(e'®) ) 

Thus  both  the  magnitude  and  the  phase  angle  (also  called  the 
phase  response)  are  examined  to  determine  the  nature  of  the 
filter  approximations. 

Advantages  to  using  an  MR  filter  are  that  it  (1)  can  be 
expressed  in  closed  form  and  thus  can  general ly  be  computed  more 
efficiently,  (2)  does  not  require  powerful  computational  facili¬ 
ties  to  be  calculated,  and  (3)  achieves  a  superior  amplitude 
response.  An  undesirable  consequence  of  using  an  MR  filter  is 
that  it  yields  a  nonlinear  phase  response.  More  on  the  linear 
phase  characteristic  is  covered  in  paragraph  5.2. 
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5,1.1  Mod««  of  t  IR  FittT  Expf»ton 


Recall  from  chapter  3  that  an  MR  filter  car,  bp  expressed  as 
N  M 

y(k)  =  E  a(i}  x(k-i)  +  E  b(i)  y(k-i)  (5-3) 

1=0  i=l 

Three  popular  modes  of  expression  for  the  transfer  function  of  an 
MR  f  i  I  ter  are 

( 1 )  the  d I r ect  form, 

(2)  the  cascade  form,  and 

(3)  the  parallel  form. 

The  forms  assume  those  names  because  when  they  are  illus¬ 
trated  in  network  diagrams,  they  are  depicted  in  the  forms 
mentioned.  In  the  following  subparagraphs,  the  mathematical 
forr.is  and  illustrations  are  given  as  well  as  the  advantages  and 
d I sadvantages . 

B. 1.1.1  Direct  Form 


As  mentioned  in  paragraph  3.6,  the  z-transform  of  a  weighing 
function,  that  is,  the  transfer  function  of  an  MR  filter  can  be 
wr 1 1 ten  as 

M 

E 

k=0 

H(z)  =  - .  (5-4) 

N 

I  -  I 
k=0 


The  network  design  illustration  for  this  equation  is  known  as  the 
direct  form  realization  of  the  MR  filter,  which  is  expressed  by 
equation  (5-3).  This  illustration  is  given  in  figure  5-1  and  is 
obtained  from  reference  56. 
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Figure  6-1.  Direct  form  realization  of  MR  filter. 


The  advantages  of  this  form  are  that  the  direct  relation 
between  the  MR  filter  equation  (5-3)  and  the  transfer  function 
equation  (5-4)  is  easily  seen,  and  It  is  easy  to  formulate 
equation  (5-4)  given  equation  (5-3).  The  disadvantage  of  this 
form  is  that  coefficients  aj^  and  b|^  are  very  sensitive  to  discre¬ 
tization  errors.  These  errors  will  affect  the  accuracy  and 
possibly  the  stability  of  the  calculations.  This  form  is  gener¬ 
ally  not  recommended  for  filters  of  order  three  or  higher. 

5. 1.1, 2  Caaoada  Form 

Equation  (5-4)  can  be  rewritten  as 


M, 


Mr 


I  (1  -  g,^z~^)  Ed-  ht,z~’)(1  -  n^z'h 


k=l 


k=1 


H(z)  =  A 


N 


Nr 


Em-  c^z"m  Em-  d,^z"')M  -  d,^2”’) 

k=1  k^l 


(5-5) 
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where  +  M2  =  M  and  +  N2  =  N.  The  numbers  g|^  and  Cj^  are 

the  real  zeroes  and  poles  of  the  transfer  function.  The  numbers 
hk,  hk,  dkr  and  dk  are  the  complex  conjugate  zeroes  and  poles  of 
the  transfer  function.  (A  is  a  real  number.) 


This  equation  can  be  written  as 


H  (z) 


( (N+1) /2) 
A  I 
k=1 


1  +  tlk*"’  ^  -2k*"^ 


(5-6) 


(where  [{N-*-1)/2]  is  the  greatest  integer  less  than  or  equal  to 
(N+1)/2).  Assume  that  M<N.  If  N<M,  replace  N  in  equation  (5-6) 
with  M. 


The  network  design  illustration  for  this  equation  is  known 
as  the  "cascade  form  realization"  of  the  IIR  filter,  which  is 
expressed  by  equation  (5-3).  This  illustration  is  given  in 
figure  5-2  and  is  obtained  from  reference  56. 


_  _  , 

■I 

n 

1 

M| 

Di 

1  / 

n 

n 

1 

.IHI. 

|Byi, 

1  / 

mBm, 

] 

,SH 

■1 

91 

,  j 

■ 

n 

1 

IKm. 

1  t 

mm, 

< 

Figure  5-2.  Cascade  form  realization  of  the  MR  filter. 


The  advantages  of  this  form  'are 

(1)  the  zeroes  (roots)  of  H(z)  are  easy  to  find, 

(2)  it  is  convenient  to  use  for  filters  whose  parame¬ 
ters  are  to  be  computed  and  changed  in  real  time,  and 

(3)  the  poles  (roots  of  the  denominator)  are  easy  to 

find. 
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Th«  poles  are  important  baoause  they  determine  the  stability  of  a 
filter.  The  filter  Is  stable  if  and  only  If  the  poles  are  inside 
the  unit  circle.  If  a  pole  Is  on  the  unit  circle,  other  criteria 
have  to  be  used  to  determine  stability. 

A  disadvantage  of  this  form  Is  that  it  is  heavily  subject  to 
underflow  and  overflow  problems. 

PsrsttsI  Form 

Equation  (5-4)  can  be  rewritten  In  terms  of  a  partial 
fraction  expansion  as 


H(z)  =  £ 


k»1  1  -  Ci,z 


^2  B^d  -  a^z'b  M-N 

+  £  - = - 2 -  +  £  C^z‘ 

k«1  (1  -  d,.z“’){1  -  d*z“’)  k»1 

k 


(5-7) 

The  first  two  terms  in  equation  (5-7)  can  bo  combined  so  that  the 
equation  becomas 


H(z) 


M-N  ,  I(N+1)/21  Tok  +  TikZ*’ 

£  +  £  - - - - 

k*1  k«1  1  -  -  ^2k*~ 


(5-8) 


The  network  design  illustration  for  this  equation  is  known 
as  the  "parallel  form  realization”  of  the  I IR  filter,  which  is 
expressed  by  equation  (5-3).  This  illustration  is  given  In 
figure  5-3  and  Is  obtained  from  reference  55. 

An  advantage  of  this  form  is  that  the  problems  mentioned  for 
the  direct  and  cascade  forms  are  normally  not  encountered.  A 
disadvantage  is  that  while  pole  locations  can  be  easily  located 
(as  in  the  cascade  form),  the  zeroes  cannot. 
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Figure  5-3.  Para  I  I e I  -  form  realization  with  the  real  and 
comple>(  poles  grouped  in  pairs. 


6.1.2  Converting  From  Analog  to  Digital 

The  filters  to  be  discussed  in  subparagraph  5.1.3  were 
originally  derived  in  the  analog  form.  Since  these  filters  were 
discovered,  a  need  developed  to  use  frequency  domain  filters  in 
the  digital  form.  Because  the  art  of  analog  filter  design  is 
highly  advanced,  it  is  considered  advantageous  to  adopt  the 
design  procedures  developed  for  the  analog  form  to  convert  to  the 
digital  form.  In  this  section  four  methods  of  ana  I og-to-d i g i ta I 
conversion  are  given  along  with  their  advantages  and  disadvan¬ 
tages  . 


The  two  desirable  properties  of  any  conversion  method  are 


(1)  The  frequency  axis  in  the  "s  plane"  (the  analog 
plane)  be  mapped  to  the  unit  circle  in  the  "z  plane"  (the  digital 
plane),  ensuring  that  there  is  a  one-to-one  mapping  between 
frequencies  in  the  s  plane  and  frequencies  in  the  z  plane.  If 
this  property  is  satisfied,  the  "frequency  selective  properties" 
of  the  analog  filter  are  said  to  be  preserved.  With  a  conversion 
method  that  has  this  characteristic,  the  digital  filter  should 
filter  through  all  and  only  those  frequencies  that  the  analog 
filter  filters  through. 

(2)  The  left  half  of  the  s  plane  IReisNO)  be  inside 
the  unit  circle  in  the  z  plana  (lzl<1),  which  ensures  the  pre¬ 
servation  of  filter  stability. 

All  the  recommended  conversion  methods  described  in  these  sub- 
paragraphs  have  at  least  the  second  property. 

5 . 1 . 2 . 1  Impulas  I nvr  lanes 

The  main  idea  of  the  impulse  invariance  method  is  to  pre¬ 
serve  the  impulse  response  when  converting  from  analog  to  digi¬ 
tal.  That  is,  the  purpose  is  to  ensure 

h(n)  =  h3(nT)  (5-9) 

where  T  is  the  sampling  period,  h  is  the  digital  impulse  re¬ 
sponse,  and  hg  is  the  analog  impulse  response.  In  other  words, 
the  characteristic  property  of  this  transformation  is  that  the 
impulse  response  of  the  resulting  digital  filter  is  a  sampled 
version  of  the  impulse  response  of  the  analog  filter.  Use  the 
f o I  lowing  method : 

(1)  set  up  analog  transfer  function  His)  in  direct, 
cascade,  or  parallel  form.  (Generally,  the  parallel  form  is  the 
most  preferable,  because  it  is  easy  to  perform  step  (2)  when 
using  a  table  for  transform  pairs); 

(2)  obtain  the  inverse  Laplace  (or  Fourier)  transform 
of  H(s),  giving  the  analog  impulse  response  function  h(t); 

(3)  get  your  digital  impulse  response  function  h(n) 
using  equation  (5-9);  and 

(4)  take  the  z-transform  of  h(n)  to  obtain  your 
digital  transfer  function  H(z). 

Steps  (2)  and  (4)  are  jointly  justified,  because  it  can  be  shown 
that  the  Laplace  transform  of  the  analog  function  h^  is  related 
to  the  z-transform  of  the  digital  function  h(t)  bv 
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H 


(5-  !  0) 


=  (1/T) 


z=e 


sT 


k= 


(s  +  I  (2n/T)k)  . 


With  the  z-transform,  the  relationship  z=e®  is  used  in 
going  from  the  s  plane  (for  the  analog  function)  to  the  z  plane 
(for  the  digital  function).  Each  horizontal  strip  of  the  left 
half  of  the  s  plane  of  width  2n/l  is  mapped  into  the  unit  circle 
in  the  z  plane  (see  figure  5-4,  obtained  from  reference  55). 

This  .-fiu  I  t  i  p  I  e  mapping  may  lead  to  aliasing  (explained  in  chapter 
3)  because  distinct  frequencies  from  different  strips  in  the  s 
plane  can  be  translated  into  one  frequency  in  the  z  plane. 


s 


The  occurrence  of  al i as i ng  can  be  seen  by  noting  that  if 
a  +  in,  then 


z 


,sT 


e^^(cosnT  + 


i  *s I nnT) 


=  e^^(cos(0  + 


(2nn/T))T  + 


i  «s I n lo 


(2nn/T) )T) 


(5-M  ) 


for  any  integer  n. 


Figure  5-4.  The  mapping  of  a  horizontal  strio  of  width  2n/T 

in  the  s  plane  to  the  unit  circle  of  the  z  plane, 
through  the  impulse  invariance  method. 


A  disadvantage  in  using  this  method  is  that  it  is  subject  to 
al  iasing.  This  method  works  best  when  used  with  band  I  imited 
filters  such  as  low  pass  and  band  pass. 

6. 1.2, 2  Bilinear  Tranaformat ton 


With  the  bilinear  transformation,  to  go  from  the  s  plane 
(which  represents  the  analog  filter)  to  the  z  plane  (which 
represents  the  digital  filter),  the  following  equation  is  used: 

1  +  (T/2)s 

2  =  -  (5-12) 

1  -  (T/2)s 

Likewise,  s  can  be  expressed  in  terms  of  z  by 
2  \  -  z~^ 

s  =  -  (5-13) 

T  1  +  z‘^ 

That  is,  the  transfer  function  of  the  digital  filter,  H(z),  is 
set  equal  to  the  transfer  function  of  the  analog  filter,  H(s), 
where  s  is  expressed  in  terms  of  z  as  in  equation  (5-13),  or 

where  z  is  expressed  in  terms  of  s  as  in  equation  (5-12),  These 

equations  were  obtained  by  the  procedure  outlined  next. 

A  digital  filter  is  essentially  a  difference  equation.  For 
an  analog  filter,  a  differential  equation  is  used.  The  analog 
transfer  function  is  obtained  by  using  Fourier  or  Laplace  trans¬ 
forms.  To  oDtain  the  bilinear  transformation,  integrate  both 
sides  of  the  differential  equation  and  use  a  numerical  approxima¬ 
tion  to  the  integral  so  that  the  integrated  equation  is  expressed 
in  discrete  terms.  Then  take  the  z-transform  of  this  equation  to 
get  the  digital  transfer  function.  When  comparing  the  analog  and 
digital  transfer  functions,  it  can  be  seen  that  s  and  z  are 
reiated  as  stated  in  equations  (5-12)  and  (5-13).  Reference  55 
gives  the  derivation  of  these  equations  in  more  detail. 

Illustrated  in  figure  5-5,  which  was  obtained  from  reference 
55,  is  the  relationship  between  s  and  z. 
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Figure  5-5.  The  mapping  of  the  left  half  of  the  s  plane  to 
the  unit  circle  of  the  z  plane,  using  the 
bilinear  transformation. 


Reference  55  shows  that  the  analog  frequency  can  be  expressed 
in  terms  of  the  digital  frequency  as  follows: 

Q  =  (2/T) tan(o/2)  (5-14) 

The  graphic  relationship  between  fi  and  o  is  given  in  figure  5-6, 
which  was  obtained  from  reference  54. 


Figure  5-6.  The  relation  between  analog  and  digital  fre¬ 
quency  scales  for  tne  bilinear  transformation. 
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As  seen  from  the  last  two  figures,  the  bilinear  transformation 
maps  an  infinite  range  of  frequencies  onto  the  unit  circle, 
representing  a  finite  range  of  frequencies.  This  mapping, 
consequently,  distorts  the  frequency  scale. 

The  frequencies  of  interest  in  the  s  plane  must  be  predis¬ 
torted  to  make  sure  they  will  come  out  in  the  right  places  in  the 
2  plane.  The  predistortion  formula  is 

2 

Q  -  - .  (5-15) 

T*tan (oT/2) 

To  sum  up,  this  method  will  probably  produce  warping  in  the 
frequency  axes.  Frequencies  In  the  s  plane  are  mapped  into 
frequencies  in  the  z  plane  in  a  distorted  manner.  To  make  up  for 
this  distortion,  the  frequencies  can  be  prewarped.  As  given  in 
equation  (5-15),  this  method  satisfies  property  (1)  of  subpara¬ 
graph  5.1.2.  This  method  works  best  when  used  with  nonband- 
limited  filters  such  as  band  stop  or  high  pass. 

5. 1.2. 3  Direct  Mepplna  of  PI f ferent l«l> 

There  are  three  ways  to  employ  the  direct  mapping  of  differ¬ 
entials:  backward  difference,  forward  difference,  and  general¬ 

ized  difference.  Consider  the  following  differential  equation 
representing  the  analog  filter: 

N  d'y(t)  M  d'x(t) 

I  a.  - ^ —  =  I  b,  - -  (5-16) 

i=0  dt'  i=0  dt' 

Equation  (5-16)  is  then  discretized  by 

N  M 

I  ajAjty(n)]  =  £  bjAj[x(n)]  (5-17) 

i=0  i=0 

where  Ajfy{n)]  is  the  i^*^  difference  defined  by  the  recursion 

A,+^[y(n)]  =  A^{AjCy(n)])  (5-18) 
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and  by  the  Initialization 


I(1/T)(y(n)  -  y(n~l)]  backward  difference 
(1/T)(y(n+1)  -  y(n)]  forward  difference 

1  L 

-  £  w-ifyCn+i)  -  y(n-i)l  generalized  difference 


and  is  defined  in  the  same  way.  The  factor  for  the 

generalized  difference  is  a  constant  of  the  user’s  choice. 

Backward  Differences:  When  using  backward  differences,  make 
the  replacement 


dy  y(n)  -  y(n-1)  (5-20) 

—  I — »  —  - - 

dt  T 

which,  in  terms  of  the  relationship  between  s  and  z,  corresponds 
to 


and 


(5-21) 


(5-22) 


The  relationship  between  s  and  z  is  Illustrated  in  figure 
5-7,  (obtained  from  reference  54) .  As  can  be  seen* proper ty  (1) 
mentioned  in  subparagraph  5.1.2  (one-to-one  frequency  correspon¬ 
dence)  is  not  satisfied  and  that  property  (2)  (stability  preser¬ 
vation)  is  satisfied. 


5-12 


Figure  5-7.  s  plane  to  z  plane  mapping  of  JQ  axis  for 
method  of  backward  differences. 


Reference  55  describes  how  property  (1)  becomes  closer  to 
being  satisfied  the  higher  the  sampling  rate.  The  high  sampling 
rate  required  to  make  this  technique  adequate  for  ana  I og-to~d i g i - 
tal  conversion  is  said  to  result  In  a  very  inefficient  represen¬ 
tation  of  the  filter  and  the  input  signal.  This  technique  is 
considered  usable  for  low-pass  filters  only.  An  example  for 
which  this  technique  can  be  used  is  air  flight  control,  where 
frequencies  are  normally  at  100  Hz  or  less.  An  advantage  of  this 
method  is  the  simplicity  of  the  design. 

Forward  Differences:  When  using  backward  differences,  we 
make  the  replacement 

dy  y  (n+ 1 )  -  y ( n) 

—  < - >  -  (5-23) 

d  t  T 

which,  in  terms  of  the  relationship  between  s  and  z,  corresponds 
to 


s  = 


z  - 


T 


and 


z  =  1  +  sT 


(5-24) 


(5-25) 
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The  mapping  of  the  frequency  axis  from  the  s  olane  to  the  z 
plane  is  illustrated  in  figure  5-8,  as  obtained  from  reference 
54.  As  can  be  seen  property  (1)  mentioned  in  subparagraph  5.1.2 
(one-to-one  frequency  correspondence)  is  not  sati.  i  ed .  Also 
shown  from  either  equation  (6-16)  or  equation  (5-17)  property  (2) 
(stability  preservation)  is  not  satisfied  either.  This  method  is 
not  recommended. 


Figure  5-8.  s  plane  to  z  plane  mapping  of  jO  axis 
for  method  of  forward  differences. 


Generalized  Differences;  As  can  be  seen  from  equation 
(5-19).  this  method  uses  higher-order  differences  to  replace 
lower-order  differentials.  The  mapping  between  tne  s  plane  and 
the  z  plane  for  this  method  is 


1  L 

I  •‘i  (z'  -  z" '  )  (5-26) 

T  1  =  1 


wnere  L  is  the  order  of  difference  to  be  used.  Reference  54 
shows  that  with  the  proper  choice  of  coefficients  •<[  ,  the  fre¬ 
quency  axis  m  the  s  plane  is  mapped  monoton i ca I ! y  to  the  unit 
circle  in  the  z  plane,  thereby  satisfying  property  (1)  in  sub- 
paragraph  5.1.2.  The  mapping  of  equation  (5-26)  can  be  shown  to 
be  conformal.  A  conformal  mapping  preserves  angles  and  relative 
locations  of  points  from  the  domain  to  the  range.  (From  this 
conformal ity,  the  left  half  of  the  s  plane  is  mapped  to  the 
inside  of  the  unit  circle  of  the  z  plane,  therebv.  showing  that 
property  (2)  is  satisfied.) 
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This  method  is  considered  efficient  and  accurate,  if  the  aporo- 
priate  coefficients  •«(  can  be  found.  It  is  normally  difficult  to 
determine  these  coefficients.  As  a  result,  other  techniques  for 
digitizing  filters  are  sought. 

6. 1.2. 4  Matched  2-Tranaforrwt lor> 

The  matched  z-transf ormat i on  is  motivated  by  the  following 
facts,  stated  without  proof: 

(1)  to  maintain  stability,  all  the  poles  of  H(z),  the 
transfer  function  in  the  z  plane,  must  lie  within  the  unit 
circle,  and 

(2)  all  poles  and  zeroes  must  either  be  real  or  occur 
in  complex  conjugate  pairs. 

As  such,  this  method  matches  poles  and  zeroes  m  the  s  plane 
to  poles  and  zeroes  in  the  z  plane.  For  a  real  pole  or  zero,  say 
-a,  the  transformation  is 

s  +  a  - ►  1  -  z'U*'®’’’  (5-27) 

where  T  is  the  samp  I  i ng  period. 

For  complex  conjugate  poles  or  zeroes,  say  a+pi,  the  transforma¬ 
tion  is 

(s+a-b i ) (s+a+b i )  = 

(s+a)^  +  b^  - ►  1  -  2z“ * e“®^cos (bT)  +  (5-28) 

(Since  b=0  in  the  real  case,  it  is  easily  seen  that  equation 
(5-28)  can  be  simplified  to  equation  (5-27).)  The  continuous 
transfer  function  H(s)  must  be  in  factored  form  to  apply  the 
transformation.  The  advantages  of  this  method  are  that  it 
ensures  stability  (it  was  designed  to)  and  that  it  is  very  easy 
to  implement.  One  disadvantage  is  that  it  may  lead  to  aliasing. 
For  instance, 

0  0  0  0 
(s+a)-  +  b  yields  the  same  transformation  as  (5+3)“^  +  (b+2rc)  . 

(5-29) 

This  transformation  is  considered  unsuitable  where  H(s)  is  an 
all-pole  system;  that  is,  H(s)  has  only  poles  and  no  zeroes. 

Quite  often  for  this  case,  H(z)  is  an  all-pole  system  that  does 
not  adequately  represent  the  desired  continuous  system.  General¬ 
ly.  the  bilinear  transformation  and  impulse  invariance  methods 
are  said  to  be  preferred  over  the  matched  z-transf ormat 1  on . 
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5.1.3  Low~Pa««  MR  Fllfr« 


Discussed  next  are  three  classes  of  low-oass  MR  filters: 
the  Butterworth,  the  Chebyshev,  and  the  elliptic  (or  "Cauer") 
filters.  Each  of  these  filters  takes  the  form 

1 

H(«)2  =  -  (5-30) 

1  +  e^f(y,(«) 

where  H  is  the  frequency  response,  o  is  the  frequency  variable,  N 
is  the  order  of  the  filter,  €  is  a  factor  in  the  interval  10, 13 
that  determines  the  height  of  the  passband  ripples,  and  f  is  an 
nth-order  polynomial  containing  only  odd  or  only  even  powers  of 
O.  Bandpass,  high-pass,  and  band-rejection  filters  can  then  be 
designed  from  any  of  the  aforementioned  low-pass  filters  using 
the  methods  described  in  chapter  4. 

6. 1.3.1  Butterworth  FI  I  fra 


Butterworth  filters  take  the  form 

1 

1  H(tt)  I  2  =  -  (5-31) 

1  + 

Where  is  the  cutoff  frequency  of  the  filter. 

The  Butterworth  filter  contains  the  following  characteris¬ 
tics: 


(1)  It  IS  defined  by  the  property  that  the  magnitude 
response  I  H(<»)  i  is  maximal  ly  flat  in  the  passband,  meaning  that 
the  maximum  number  of  derivatives,  2N  -  1,  of  the  squared  magni¬ 
tude  function  I  H(«)  I  ^  are  equal  to  zero  at  o=0. 

(2)  1  H(o)  1  =  1 //*2  at  the  cutoff  frequency  since, 

when  attempting  to  simulate  the  ideal  low-pass  filter,  it  is 
desired  that  n->w| im  I  H(©)  I  =  I  for  all  ©  in 

( -©^ ,  ©g]  .  (  I  im  I  H  (©)  1  =  1  for  all  I  ©  I 
IM-  ><» 

(3)  It  is  computationally  and  conceptually  simpler 
than  the  Chebyshev  and  ellipt.c  filters. 

(4)  The  higher  N  is,  the  better  this  filter  simulates 
the  ideal  low-pass  filter. 

(5)  The  magnitude  of  the  frequency  response  is  monoto¬ 
nic  in  both  the  passband  and  the  stop  band. 
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Illustrations  of  the  Butterworth  filter,  obtained  from 
reference  55,  can  be  seen  in  figure  5-9. 


Figure  5-9.  Dependence  of  Butterworth  magnitude 
characteristic  on  the  order  N. 


6. 1.3. 2  Chabvhav  F 1 1  f  r« 

Chebyshev  f i I ters  take  the  form 

1 

1h(«)1  2  =  - - -  (5-32) 

1  + 

N  ^ 

where  V|yj(x)  is  the  nth  order  Chebyshev  polynomial  defined  by 

V|,^j(x)  =  cos  (Ncos“  '  x)  .  (5-33) 

(For  example,  for  N=2,  Vjg  ( x )  =V2  (x)  =2x^- 1  .  )  (5-34) 

The  Chebyshev  filter  contains  the  following  characteristics: 

(1)  It  distributes  uniformly  the  inaccuracy  in  simu¬ 
lating  the  ideal  LP  filter  in  either  the  passband  or  the  stop 
band  (but  not  both).  That  is,  it  produces  an  gquiripple  curve 

either  in  the  passband  (about  the  l  ine  1  H(®)  I  ^^=1)  or  in  tne  stop 

band  (about  the  I ine  I  H (•)  i  ^=0) . 
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(2)  It  usually  leads  to  a  lower-order  polynomial  than 
does  the  Butterworth  filter  to  accomplish  the  same  result. 

There  are  two  types  of  Chebyshev  filters.  Chebyshev  Type  l 
filters  are  equiripple  in  the  passband  and  monotonic  in  the  stop 
band.  Chebyshev  Type  II  filters  (sometimes  called  inverse 
Chebyshev  filters)  are  monotonic  in  the  passband  and  equiripple 
in  the  stop  band.  Figure  5-10,  obtained  from  reference  54, 
illustrates  Type  I  and  Type  II  Chebyshev  filters  of  odd  and  even 
orders.  (The  A  near  the  vertical  axes  is  what  reference  54  uses 
at  the  parameter  related  to  stop-band  loss.) 


Figure  5-10.  Type  I  and  II  Chebyshev  filters 
of  odd  and  even  orders. 


6, 1.3. 3  El  I  Iptio  FI  I  fra 

Elliptic  (or  Cauer)  filters  take  the  form 


I  H(0)1  2 


1 

1  +  €2u2(o,L) 


(5-35) 


where  U|yj(o,L)  is  a  Jacobian  eHiptic  function.  Discussion  of 
this  function  is  highly  intricate  and  is  bevond  the  realm  of  this 
paper.  Those  interested  in  studying  this  function  are  referred 
to  reference  68.  Those  interested  in  further  studying  the  design 
of  eliiptic  filters  are  referred  to  references  59,  60,  and  61. 

The  elliptic  filter  contains  the  following  characteristics: 

(1)  It  distributes  uniformly  the  inaccuracy  in  simu¬ 
lating  the  ideal  LP  filter  in  both  the  passband  and  the  stop 
band.  In  other  words,  it  produces  an  equiripple  curve  in  the 
passband  (about  the  line  1h(#)1  ^=1)  and  in  the  stop  band  (about 
the  I  me  I  H(|»)|  2  =o)  . 

(2)  it  yields  a  smaller  transition  band  than  does  the 
Chebyshev.  (Note  that  the  Butterworth  filter  does  not  yield  a 
transition  band.) 

Figure  5-11,  obtained  from  reference  55,  illustrates  the 
elliptic  f  I  I  ter . 


Figure  5-11.  Equiripple  approximation  in 
both  passband  and  stop  band. 
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B .  2  Fin  If  tmpul««  Ri»pon««  (FIR)  FiltT  Dial  on 


The  FIR  filters  were  briefly  described  in  paragraphs  ’.;7  and 
1.8.  In  this  section,  modes  of  expression  for  FIR  filters  and 
FIR  filter  design  techniques  are  given.  A  disadvantage  in 
impiementing  an  FIR  filter  is  that  it  cannot  be  expressed  in 
closed  form.  Instead,  it  must  be  calculated  through  iterative 
procedures,  and  thus  generaliy  requires  a  great  deal  of  computa¬ 
tional  time  and  the  use  of  powerful  computational  facilities. 

in  many  s i gna I -process i ng  applications,  phase  relations  are 
important  and  inust  not  be  disturbed  by  filtering.  For  such 
purposes,  a  zero  phase  shift  would  be  ideal;  in  oractice,  howev¬ 
er,  a  filter  whose  phase  shift  is  proportional  to  frequency  is 
generally  used.  Such  a  filter  is  called  linear  phase.  An 
advantage  in  using  FIR  filters  is  that  they  can  have  exact  linear 
phase.  Referring  to  figure  3-6,  it  has  been  found  that  the  most 
favorable  conditions  for  an  FIR  design  are  large  values  of  Sp 
small  values  of  d2>  large  transition  widths. 

5.2.1  Modes  of  FIR  Filter  Expression 

An  FIR  filter  can  be  expressed  as 

N 

y(k)  =  £  a(i)  xlk-i)  (5-36) 

(=0 


There  are  four  popular  modes  of  expression  for  the  transfer 
function  of  an  FIR  filter.  They  are 

(1)  the  direct  form, 

(2)  the  cascade  form, 

(3)  the  frequency  sampling  form,  and 

(4)  the  linear-phase  form. 

The  first  two  forms  assume  those  names  because  when  they  are 

illustrated  in  network  diagrams,  they  are  depicted  in  the  forms 
mentioned.  The  direct  and  cascade  FIR  forms  may  be  derived  from 
the  corresponding  MR  forms  by  simply  omitting  the  pole-producing 
portions  of  the  MR  forms.  (The  second  term  on  the  right-hand 
side  of  equation  (5-3)  generates  the  pole-producing  terms  in  the 
MR  modes  of  expression.)  The  advantages  and  disadvantages  of 
the  direct  and  cascade  forms  are  essentially  the  same  for  FIR 
filters  as  they  are  for  MR  filters.  As  a  result,  it  will  be 
sufficient  just  to  give  their  forms  in  the  following  subpara¬ 
graphs  . 
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The  frequency  sampling  form  for  FIR  filters  is  a  type  of 
parallel  form  of  I IR  filters  but  is  derived  in  an  entirely 
different  way  from  the  parallel  form.  The  fact  that  FIR  filters 
can  have  exact  linear  phase  is  used  for  the  linear-phase  form. 
When  given  its  form,  It  will  be  easy  to  see  how  it  can  produce 
considerable  savings  in  computations. 

5. 2. 1.1  DIrsot  Form 

The  direct  form  of  the  transfer  function  for  FiR  filters  can 
be  found  to  be 


H(2)  =  I  (5-37) 

lc»0 

6. 2. 1.2  Cascade  Form 

The  cascade  form  for  the  transfer  function  of  FIR  filters  is 
Y{z)  K 

H(z)  =  -  =  an  ^  (5-38) 

X(z)  i=1 

where  Hj(z)  is  either  a  seuond-order  cascade  section,  that  is, 

Hj(2)  =  1  +  «,jZ''^  +  a2jZ'’^  (5-39) 

or  a  first-order  cascade  section,  that  is, 

Hj (z)  =  1  +  a, ,z'’  (6-40) 

and  K  is  the  integer  part  of  (N+1)/2,  where  N  is  the  order  of  the 
f i I  ter  . 

It  should  be  mentioned  here  that  if  linear-phase  filters  are 
realized  in  this  form,  sensitivity  to  discretization  errors  in 
the  coefficients  wiil  be  less,  but  the  errors  may  destroy  the 
phase  I i near i ty . 

6. 2. 1.3  Frequency  Samp  I ‘ng  Form 

As  mentioned  in  subparagraph  5.2.1,  this  form  is  a  type  of 
parallel  form  but  is  derived  differently  from  the  parallel  I IR 
form.  The  parallel  MR  form  was  derived  from  a  par  1 1  a  I -f  ract  i  on 
expansion  of  the  transfer  function.  Since  par t i a  I - f r ac t i on 
expansions  are  based  on  poles,  this  approach  cannot  be  considered 
for  FIR  filters.  This  form  is  derived  by  a  design  technique 
called  the  frequency  sampling  design  technique  and  is  explained 
in  subparagraph  5. 2. 2. 2. 
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6. 2. 1.4  LlnaT-Phaaa  Form 


Many  applications  require  filters  whose  phase  response  is 
linear  with  frequency.  It  can  be  shown  that  linear-phase  FIR 
filters  have  a  symmetrical  Impulse  response,  that  is,  for  an 
N-order  f i I  ter 

h(n)  =  h(N-l-n)  (5-41) 

This  symmetry  requirement  leads  to  certain  economies  in  implemen¬ 
tation.  In  an  FIR  filter,  the  h's  corresporid  one-to-one  with  the 
a’s  of  equation  (B-37) .  Because  of  the  symmetry  in  h(n),  equa¬ 
tion  (5-37)  becomes 

y(n)  =  aQx(n)  +  a^x(n-l)  +  ...  +  a^x(n-N-l)  +  aQx(n-N) 


(B-42) 


which  can  be  written  for  N  even,  as 
N/2  -  1 

y(n)  =  J  b^ tx (n-1 ) +x (n-N+ i ) ]  (B-43) 

i=0 


or  for  N  odd,  as 

(N-1)/2  -  1 

y(n)  =  bfy|/2’<(n  “  N/2)  +  E  b_  (x  (n- 1 ) +x  (n-N+ i )  ] 

1=0 


(B-44) 

Since  the  number  of  terms  in  the  sum  is  reduced  by  approximately 
one-half,  considerable  economies  in  computation  are  achieved. 
Because  of  the  symmetry  in  this  form,  errors  in  quantizing 
coefficients,  that  is,  discretization  errors  of  the  coefficients, 
will  not  disturb  the  linear-phase  characteristic  although  perfor¬ 
mance  but  may  still  degrade  performance. 

B.2.2  FIR  Filter  Das  I  an  Taohntquas 

The  techniques  covered  in  this  section  are 

(1)  windowing, 

(2)  frequency  sampling  design,  and 

(3)  equirippte  design. 
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There  are  many  types  of  windowing  and  some  will  oe  oriefly 
described  h^re.  The  second  two  techniques  are  computer-aided 
design  techniques  and  require  a  great  deal  of  iterative  calcula¬ 
tion. 


S . 2 . 2 . 1  W I ndow I  no 

It  is  natural  to  design  a  filter  by  first  simulating  the 
ideal  low-pass  filter,  defined  in  equation  (3-16).  In  doing  so, 
the  impulse  response  h(n)  should  meet  these  two  conditions:  (a) 
it  is  finite,  and  (b)  it  is  causal.  In  particular,  that  h(n)  =  0 
f'.  r  n  <  0 . 


The  impulse  response  is  the  inverse  Fourier  transform  of  the 
transfer  function.  The  impulse  response  of  the  ideal  low-pass 
filter  transfer  function  can  be  found  to  be 

s I n (tt^n) 

h(n)  - -  (5-45) 

n 


Neither  condition  (a)  or  (b)  above  is  met.  The  ideal  low-pass 
filter  and  h(n)  are  shown  in  figures  5-12a  and  5-12b,  obtained 
from  reference  56. 
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F^aure  5-12.  (a)  Ideal  low-pass  filter  characteristic 

with  cutoff  at  0^,  and  (b)  impulse  response 
corresponding  to  ideal  low-pass  filter. 
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A  solution  to  meeting  conditions  (a)  and  (b)  is  to  find  a 
finite,  causal  approximation  to  h(n)  which  can  be  done  by  window¬ 
ing  the  impulse  response,  (by  truncating  it  for  I  n  1  greater  than 
some  cutoff  time)  and  by  shifting  the  response  in  time  until  the 
system  is  causal.  The  two  steps  are  shown  in  figures  5-I3a  and 
5-13b,  obtained  from  reference  56. 

As  explained  towards  the  end  of  paragraph  3.3,  truncating 
the  impulse  response  would  result  in  a  boxcar  function  with 
ripples  (see  figure  5-13c).  Three  deviations  from  the  ideal 
low-pass  filter  emerge: 

(1)  the  passband  response  is  no  longer  flat  but  shows 
ripples  that  steadily  increase  in  amplitude  until  the  cutoff 
frequency , 

(2)  the  stop-band  response  is  no  longer  zero,  and 

(3)  the  transition  between  passband  and  stop  band  is 
no  longer  abrupt. 


Figure  5-13. 


(a)  Truncated  version  of  impulse  response  in 
figure  5-12,  (b)  Truncated  response  shifted 

so  as  to  make  system  causal,  and  (cl  Filter 
frequency  response  resulting  from  truncation 
of  impulse  response. 
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To  minimize  these  ripples,  multiply  the  original  infinite- 
impulse  response  by  a  windowing  function  (other  than  the  rectan¬ 
gular  function  that  was  initially  introduced).  There  is  no 
finite  window  function  whose  transform  has  no  side  lobes,  but 
functions  can  be  found  whose  transforms  have  very  small  side 
lobes.  If  one  of  these  functions  is  used,  the  ripples  in  the 
frequency  response  will  be  correspondingly  reduced. 

Some  of  the  best-known  windowing  functions  are  listed  in 
table  6-1  and  shown  in  figure  5-14,  along  with  their  transforms. 
(The  table  and  figure  are  obtained  from  reference  56.) 


TABLE  8-1. 

COMMON  8IIND0WINQ  FUNCTIONS 

Name 

Description* 

Rectangular 

w{k) «  I 

Fejer«Barltetl 

w(A)-1-12X/^| 

Hanning 

w{k)  ••  ( 1  4-  cos  «k/ N  )/2 

Hamming 

w{k)  0.54  +  0,46  cosffA'/ N 

/ofw.Vl-U/W)’] 

Kaiser 

/JW.) 

•For  all  windows. 

w{k) «  0  for  (A'l  >  N. 

For  the  Kaiser  window,  !q  is  the  zeroth-order  Bessel  func¬ 
tion  and  ea  is  a  constant  that  specifies  a  frequency  response 
tradeoff  between  peak  height  of  the  side  lobe  ripples  and  the 
width  or  "energy"  of  the  main  lobe.  (The  Fe j er -Bar t I et t  window 
IS  also  called  the  triangular  window.)  Reference  55  also  men¬ 
tions  the  Blackman  window,  which  is  tt(n)  =  0.42  -  0.5cos(2nn/ 
(N-D)  +  0.08cos(4nn/(N-1))  ,  0<_n<N-1  . 
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Figure  5-14.  Common  window  functions  and  their 
transforms:  (a)  rectangular, 

(b)  triangular  (Fe j er-Bar t I ett) , 

(c)  Hanning,  (d)  Hamming,  and 
(e)  Kaiser. 
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Figure  5-14  (Con.).  Common  window  functions  and  their  trans* 

forms:  (a)  rectangular,  (b)  triangular 
(Fe jer-Bar t I ett) ,  (c)  Hanning, 

(d)  Hamming,  and  (e)  Kaiser. 


Reference  55  compares  various  windowing  functions  in  one  graph, 
which  IS  inserted  here  as  figure  5-15. 

In  all  of  these  windowing  functions,  the  side  lobes  are  much 
smaller  than  those  resulting  from  the  rectangular  window,  and  the 
main  lobes  are  all  wider  than  those  resulting  from  the  rectangu¬ 
lar  window,  producing  a  much  closer  approximation  to  the  ideal 
low-oass  filter.  The  search  for  the  ideal  windowing  function  is 
a  search  for  the  best  tradeoff  between  side  lobe  amplitude  and 
main  lobe  width.  No  FIR  filter  designed  by  Fourier  transforma¬ 
tion  and  windowing  is  optimal.  The  appeal  of  the  technique  lies 
in  Its  simplicity  and  economy. 
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Finding  the  desired  transfer  function  using  windows  can  oe 
summarized  as  follows: 

(1)  write  the  equation  for  the  desired  frequency 

response , 

(2)  find  the  impulse  response  (talcing  the  inverse 
Fourier  transform  of  the  frequency  response) , 


Figure  5-15.  Commonly  used  windows  for  FIR  filter  design. 


(3)  select  a  windowing  function  and  a  window  width  to 
meet  the  required  ripple  and  transition-width  specifications, 
(Window  the  impulse  response  accordingly,) 

(4)  shift  the  impulse  response  to  make  it  causal,  and 

(5)  take  the  Fourier  transform  of  the  product  of  the 
windowing  function  and  the  new  impulse  response.  The  result  is 
the  desired  transfer  function. 

6. 2. 2. 2  Fraquancy  Sampling  Oaalon 

The  approach  of  this  method  is  to  take  samples  of  the 
frequency  response  and  to  design  an  FIR  transfer  function  based 
on  these  samples.  The  approach  starts  by  considering  the  trans¬ 
fer  function  H(z)  of  a  digital  filter,  which  can  be  found  by 
taking  the  z-transform  of  the  impulse  response  h{n) 
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N-1 

H(z)  =  h{n)z“^  (5-46) 

n=0 


The  impulse  response  can  be  found  from  the  frequency  response  by 
applying  the  inverse  OFT  as 

N-1 

h(n)  *  (1/N)  E  H(k)W'^'^  (5-47) 

k=0 


where  W  exp(i2n/N). 

Combining  these  two  relations  gives 

N-1  N-1 

H(z)  =  (1/N)  I  z“"  I  H(k)W"’^ 
n=0  n=0 

which  can  be  rewritten  as 


H(z) 


l-z'N  N-1  H(k) 

N  k=0  l-z'^W*^ 


(6-48) 


(5-49) 


As  can  be  seen,  this  design  procedure  consists  simply  of  substi¬ 
tuting  samples  of  the  desired  frequency  response  into  equation 
(6-49)  . 

As  seen  from  the  last  equation,  there  is  a  pole  on  the  unit 
circle  which  leads  to  marginal  stability  (see  paragraph  3.8.)  To 
ensure  stability,  multiply  z”'^^  by  a  number  that  is  almost  one 
(say  1  -  2“'^).  Good  accuracy  for  this  method  requires  many 
closely  spaced  samples.  This  design  works  particularly  well  for 
narrow-band  filters  in  which  only  a  few  samples  are  nonzero. 
(Reference  55  states  that  even  if  more  than  a  few  samples  are 
nonzero,  the  frequency-sampling  design  method  yields  excellent 
results.)  A  disadvantage  of  this  method  is  that  it  lacks  flexi¬ 
bility  in  specifying  the  passband  and  stopband  cutoff  frequen¬ 
cies.  In  addition,  the  ripple  response  for  this  design  procedure 
is  poor.  Reference  65  suggests  a  method  in  which  the  ripple 
response  can  be  greatly  improved. 

6. 2. 2.3  Equiripple  Deslan 

The  approximation  error  of  the  frequency  sampling  design 
tends  to  be  highest  around  the  transition  region  and  smaller  in 
areas  remote  from  the  transition  region.  The  equiripple  design 
affords  a  way  in  which  the  approximation  error  can  be  spread  out 
more  un i formi y . 
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Of  concern  are  the  zero-phase  FIR  filters  with  frequency 
responses  of  the  form 

M 

H(e'“)  =  I  h(n)e“'®"  (5-50) 

n-=M 

For  zero-phase  filters,  symmetr i ca I  ness ,  h(n)  =  h(-n),  and 
causality  are  required.  Shift  the  summands  in  equation  (5-50) 
are  shifted  to  obtain  causality,  so  that 

M 

H(e'*^)  =  h(0)  +  £  2h  ( n )  cos  (ttn)  (5-51) 

n=  1 


To  be  specified  for  the  equiripple  curve  are  the  parameters  M, 
6^,  ^2 ,  ©p,  and  Og,  where  6^  and  62  are  the  upper  and  lower 
ripple  toTerances,  and  ttp  and  ttg  are  the  passband  and  stop  band 
cutoff  frequencies,  (see  figure  3-6  or  figure  5-16). 


Figure  5-16.  Equiripple  approximation  of  a  low-pass  filter. 


Messrs.  0.  Herrmann  and  H.  W.  Schuessler,  (references  66  and 
67);  E.  Hofstetter,  A.  V.  Oppenheim,  and  J.  Se i ge I  (references 
68  and  69);  and  J.  Selgel  (reference  70)  developed  procedures  in 
which  M,  and  62  are  held  fixed  and  Op  and  o^  are  solved. 

Messrs.  T.  W.  Parks  and  J.  H.  McC I e I  I  an , ^ (ref erences  71  and  72) 
and  L.  R.  Rab i ner  (references  73  and  74)  developed  procedures  for 
which  M,  Og,  and  Op  are  held  fixed  and  for  which  3^  and  62  are 
so  I ved . 

I 

In  an  example  using  a  method  by  Herrmann  and  Schuessler, 
there  are  five  frequencies  greater  than  0  and  less  than  n  where 
there  are  maxima  and  minima  in  the  ripples  (see  figure  5-16).  It 
can  be  easily  shown  that  for  a  symmetric  filter  of  order 
N  =  2M+ 1 ,  there  will  be  at  most  M+1  local  extrema  in  the  interval 
0<O£7x . 

Consider  the  fact  that  at  the  passband  cutoff  frequency,  the 
frequency  response  curve  is  at  the  lower  tolerance  limit  about  1 
and  that  at  the  stop  band  cutoff  frequency,  the  curve  is  at  the 
higher  tolerance  limit  about  0.  This  fact  can  be  used  to  obtain 
the  following  two  equations: 


H(e'«p) 

=  1-3. 

(5-52) 

and 

H(e'®g) 

=  <52  • 

(5-53) 

By 

the 

observ i ng 
f 0 1  lowing 

either  figure  5-16  or  equations  (5-52) 
set  of  equations  can  be  written: 

and  (5-53) , 

=  1  +  6  j  , 

H(e'")  =  3 

2 

(5-54) 

Hie'®,) 

=  1  -  6,  , 

H’  (e'®, )  = 

0 

(5-55) 

H(e'®2l 

=  1  +  6  p 

H’  (e'®2^  = 

0 

(5-56) 

H(a'®3) 

-  —  3  2  > 

H’ (e '*3)  = 

0 

(5-57) 

H(e'®4) 

—  S  2  • 

H’  (e'®4)  = 

0 

(5-58) 

H(e'®5) 

-  -62 , 

H’ (e'®5)  = 

0 

(5-59) 

For 

M-1 

this  method,  there  is  the  flexibilty  to  decide 
frequencies  properly  between  0  and  n  should  be 

wh  1 ch  of  the 
in  the  oass- 

band  and  which  ones  should  be  m  the  stop  band.  In  this  case, 
M+l=7,  there  are  seven  unknown  coefficients  (h{n))  in  equation 
(5-51).  There  are  5  unknown  frequencies  at  which 

extrema  occur,  so  there  are  12  equations  in  12  unknowns.  These 
equations  are  nonlinear  and  must  be  solved  by  an  iterative 
procedure . 
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Generally,  there  are  2M  equations  in  2M  unknowns.  This 
approach  has  been  found  to  be  satisfactory  for  orders  of  M  = 
or  lower,  and  it  provides  the  narrowest  transition  between 
passband  and  stop  band. 


CHAPTER  6 


KALMAN  FILTERS 


A  Kalman  filter  is  a  linear,  recursive  algorithm  for  comout- 
ing  an  optimal  estimate  from  measurements,  some  of  whicn  may 
contain  noise.  The  noise  on  the  measurements  is  assumed  to  be 
white;  namely,  the  noise  values  are  not  correlated  over  time. 

Also  assumed  is  knowledge  of  the  statistics  of.  the  noise  on  the 
measurements.  The  algorithm  is  recursive  and  thus  requires  an 
initial  estimate  to  start  the  filter  as  we M  as  a  guess  as  to  the 
correctness  of  that  estimate.  Finally,  the  algorithm  is  linear, 
consisting  of  matrix  equations.  (Reference  3  has  an  excellent 
intuitive  introduction  to  Kalman  filtering  in  its  first  chapter.) 

The  Kalman  filter  is  most  often  used  as  a  data-process i ng 
algorithm  (a  computer  program)  and  can  be  extremely  efficient, 
requiring  a  minimum  of  computer  storage  and  using  all  available 
data  by  weighing  the  data  measurements.  The  filter  has  the 
ability  to  take  several  different  types  of  data  and  generate  an 
estimate  of  a  totally  different  quantity.  Because  it  is  a 
predictor-corrector,  it  can  generate  its  next  estimate  based  on 
less  current  data  than  would  be  needed  for  a  directly  calculated 
solution.  The  data  need  not  be  entered  at  equally  spaced  time 
intervals,  at  the  same  time,  or  in  certain  sequences..  The  filter 
allows  the  user  to  apply  the  knowledge  of  the  behavior  and 
statistics  of  both  the  measurements  and  the  quantities  to  be 
estimated  to  obtain  the  solution;  in  fact,  these  models  and 
statistics  may  vary  with  time.  In  addition,  a  self-contained 
error  analysis  is  included  in  its  equations.  Finally,  as 
predictor,  it  is  useful  for  real-time  control. 

A  few  caveats  apply,  however.  To  begin  with,  there  is  no 
"general"  Kalman  filter.  Each  algorithm  is  dependent  on  the 
quantities  to  be  estimated  and  their  dynamics,  the  measurements 
available  and  their  statistics,  and  the  initial  valuss  needed  to 
start  the  algorithm.  Secondly,  the  algorithm  is  most  efficient 
if  matrix  inversions  can  be  avoided.  Matrix  inversions  can 
usually  be  done,  although  it  depends  on  the  application,  that  is, 
the  particular  Kalman  filter  written.  Thirdly,  a  Kalman  filter 
will  updLte  with  less  current  data  than  is  required  for  a  calcu¬ 
lated  solution,  but  if  updating  with  this  data  is  done  for  too 
long,  the  estimate  may  become  grossly  invalid.  i'ne  filter  is 
said  to  have  diverged.  Fourthly,  the  order  of  tne  input  of  data 
is  unimportant  only  for  the  basic  Kalman  filter:  a  filter  whose 
dynamic  and  measurement  models  are  both  linear.  Though  all 
derivations  and  claims  of  optimality  are  valid  only  for  such 
filters,  linearity  is  rare  in  the  real  world.  Hence,  suboptimal- 
I  ty  is  often  settled  for  using  an  extended  Kalman  filter. 
Sometimes  it  is  found  that  permuting  the  order  in  which  data  is 
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entered  may  significantly  change  the  estimate.  Finally,  the 
validity  of  the  self-contained  error  analysis  is  dependent  on  the 
degree  to  which  the  noise  statistics  fit  the  theoretical  assump¬ 
tions.  For  example,  biases  in  the  data  will  not  be  indicated  by 
the  output  error  covariance  matrix. 

Before  describing  a  Kalman  filter,  the  description  of  some 
terms  are  in  order. 

The  "expected  value"  of  g(x)  of  a  random  variable  x  whose 
frequency  function  is  fix)  is 

00 

Efglx)]  =  J*  g(x)f(x)dx 
-00 

Loosely  speaking,  the  expected  value  of  g(x)  is  the  average  of 
g  (x)  . 


An  "estimate"  is  a  computed  value  of  a  quantity.  For 
example,  the  sample  mean 


i  =  1  f| 

IS  an  estimate  of  true  population  mean  p. 

A  statistic  t  is  called  an  “unbiased  estimate"  or  “unbiased 
estimator"  of  the  parameter  v  if  E[t)  *  V.  For  example,  the 
sample  mean  x  can  be  shown  to  be  an  unbiased  estimate  of  the  true 
population  mea-i  p. 

An  "optimal  estimate"  is  one  that  minimizes  the  variance  of 
an  estimate  and  is  unbiased.  When  using  an  optimal  filter  such 
as  a  filter  computing  an  optimal  estimate,  it  is  assumed  that  the 
exact  descriptions  of  the  system  dynamics  and  the  measurement 
process  are  known.  In  addition,  an  optimal  filter  must  model  a  I  I 
error  sources  in  the  system  including  unmodeled  parameters, 
linearization  errors,  leaky  attitude  controls,  and  solar  winds. 

Error  sources  mentioned  in  the  previous  paragraph  constitute 
"process  noise,"  noise  that  stems  from  mismodeling.  Other  error 
sources  include  those  of  "measurement  noise,"  which  stems  from 
faulty  measuring  devices  or  the  misuse  of  those  devices.  (Be¬ 
cause  the  Kalman  filter  is  based  on  least  squares,  an  error 
source  inherent  in  the  Kalman  filter  is  the  difference  between 
the  estimate  sample  measurement  values  and  the  true  population 
measurement  values.)  An  example  dealing  with  unmodeled  parame¬ 
ters  is  filtering  a  position  parameter  without  including  the 
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velocity  or  acceleration  parameter  into  the  model,  which  where 
Incl'.'r^ing  these  parameters  could  facilitate  filtering  the  posi¬ 
tion  parameter. 

Leaky  attitude  controls  and  solar  winds  are  factors  that  can 
lead  a  spacecraft  off  course.  They  are  usually  considered 
negligible  and  as  such  are  normally  not  included  in  the  modeis. 
The  errors  that  may  result  from  their  not  being  included  consti¬ 
tute  process  noise. 

A  suboptima  I  f i i ter  is  a  filter  that  does  not  take  into 
account  all  the  factors  that  have  been  mentioned  in  describing  an 
optimal  f  i  i ter .  A  "predictor-corrector"  is  a  recursive  algorithm 
that  has  two  steps  to  each  recursion:  a  predictor  and  a  correc¬ 
tive  step.  A  predictor  step  is  the  state  of  the  system  predicted 
by  using  the  output  data  of  the  preceding  recursions  in  which  the 
nth  state  of  the  system  is  predicted  using  the  first  n-1  states. 

A  corrective  step  is  the  given  input  nth  state  of  the  system  used 
to  correct  the  predicted  nth  state  of  the  system,  thus  producing 
the  final  output  nth  state  of  the  system.  (The  nth  state  of  the 
system  is  the  state  of  the  system  at  the  nth  recursion.) 

6 . 1  Linear  Discrete  Kalman  Filter 


In  the  case  of  a  linear  discrete  Kalman  filter,  the  dynamics 
of  the  quantities  to  be  estimated  may  be  described  by  linear 
difference  equations.  Additionally,  the  relationship  between  the 
measurements,  taken  at  discrete  times,  and  the  estimated  quanti¬ 
ties  is  I i near . 

6.1.1  Oaf  in  1 1 ions 

To  write  such  a  Kalman  filter,  begin  with  these  definitions. 

(1)  A  model  describing  the  dynamics  of  the  quantities 
to  be  estimated.  This  model  will  be  of  the  form 

x(k)  =  ♦(k,k-1 )x(k-1 )  +  G(k,k-1 )w(k-1 )  (6-1) 


where 


k  refers  to  the  kth  time  point  tj^ ; 

x(k)  is  the  set  of  quantities  to  be  estimated,  arranged 
n  a  vector,  and  called  the  state  vector: 


♦(k,k-1)  is  called  the  transition  matrix  and  describes  the 
change  in  the  state  vector  from  time  t|^_^  to  t|^ ; 
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G(k,k“1)  is  called  the  input  matrix;  for  practical  pur¬ 
poses,  it  is  generally  taken  to  be  equal  to  the 
i dent i ty  matr i x ; 

and 


w(k-1)  is  called  the  plant  or  process  noise.  The  vector 
w(k-1)  is  assumed  to  contain  zero-mean  white  noise 
with  Gaussian  distribution.  The  vector  resulting 
from  the  product  G (k , k- t ) w(k- 1 )  represents  the 
unknown  portion  of  the  dynamic  model.  The  covari¬ 
ance  matrix  of  w(k)  is  designated  by  Q(k}. 

(2)  An  equation  relating  the  state  vector  to  the 
measurements.  The  form  of  this  equation  is 


^(k)  =  H(k)x(k)  +  v(k)  (6-2) 

where 

y(k)  is  the  measurement  at  time  t|^; 


H(k)  is  called  the  measurement  matrix  and  linearly  relates 
the  measurements  to  the  state  variables; 

and 

v(k)  is  the  measurement  noise.  The  vector  v(k)  is  assumed 
to  contain  zero-mean  white  noise  with  Gaussian 
distribution.  The  covariance  matrix  of  v(k)  is 
designated  by  R(k). 

(3)  Finally,  the  following  quantities  are  needed: 

><(0)  the  initial  state  estimate;  and 

P(0)  the  corresponding  error  covariance  matrix.  (In 

the  Kalman  filter  algorithm,  Pj^  is  the  covariance 
matrix  of  the  estimate  error  of  the  kth  state 
vector.  That  is,  Pj^.  =  E  (  (x  (k) -X|^)  (x^(k) -Xj^)  '  J  .  ) 

To  write  a  Kalman  filter,  three  matrices,  i,  G,  and  H,  are 
needed  to  define  the  dynamic  and  measurement  structures  as  well 
as  the  matrices,  Q  and  R,  to  define  the  dynamic  and  measurement 
statistics.  Also  needed  are  the  initial  values,  x(0)  and  P(0). 


Given  these 
descr i bed  next . 
estimate  of  the 
the  est imate  of 
taken  up  to  and 


items,  the  filter  is  written  using  the  equations 
!n  these  equations,  the  notation  ^  denotes  the 
state  vector  x.  The  notation  5(a/b)  signifies 
the  state  vector  at  time  tg  given  measurements 
including  time  tj^. 
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The  first  step  in  this  Kalman  filter  algorithm  is  the 
extrapolation  or  time  update  for  the  estimate  and  its  covariance 
matrix.  These  equations  are 

x(k/k~l)  =  ♦(k,k-nx{k“1/k-1)  (6-3) 

and 

P(k/k-n  =  •(k,k-n  P(k-l/k-1  )#’’’(k,k-1 )  +  G  (k ,  k- 1  )  Q  (k- 1)  g’’’ (k  ,  k- 1 )  . 

(6-4) 

The  next  step  is  to  compute  the  weighing  matrix  K.  called 
the  Kalman  gain,  by 

K(k)  =  P(k/k-l)H'^(k)  (H(k)P(k/k-nH''’(k)+R(k)  (6-5) 

Finally,  the  output  is  obtained  by 
x(k/k)  =  x(k/k-1)  +  K(k)lY(k)  -  H(k)x(k/k-nj  (6-6) 

and 


P(k/k)  =  tl  -  K(k)H(k)]  P(k/k-n,  (6-7) 

where  I  is  the  proper  size  identity  matrix. 

x(k/k)  in  equation  (6-6)  is.  ultimately,  the  result  for  the 
kth  step  in  the  algorithm.  P(k/k)  of  equation  (6-7)  is  used  as 
P(k-1/k-1)  in  equation  (6-4)  in  a  recursive  step.  Equations 
(6-3)  through  (6-7)  represent  one  recursive  step  in  the  Kalman 
f i  I  ter  a  1 gor i thm. 

Table  6-1  is  obtained  from  reference  2  and  gives  a  summary 
of  the  entire  algorithm.  The  top  two  boxes  give  the  original 
model  equations,  initial  conditions,  and  assumptions.  Equations 
(6-1)  and  (6-2)  are  equivalent  to  the  system  and  measurement 
model  equations.  (The  z  in  the  table  is  the  same  as  the  y  vector 
of  equation  (6-2).)  The  "other  assumptions"  equation  in  the 
second  box  means  that  the  system  model  errors  and  the  measurement 
noises  are  uncorrelated.  The  equations  in  the  bottom  two  boxes 
correspond  to  equations  (6-3)  through  (6-7),  which  comprise  one 
recursive  step  in  the  algorithm. 
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TABLE  6-1.  SUMMARY  OF  DISCRETE  KALMAN  FILTER  EQUATIONS 


System  Model 

Measurement  Model 

xi(“  ♦ic-iijc-l  ♦  wic-l.  JUc  ~  N(0,  Qic) 

ik'HicJac+vjt,  vk~N(0,Rjt) 

Initial  Conditiolu 

Other  Assumptions 

Elx(0)l  »io.  EI^(0)  -io)(x(0)  -  xo)Tj  .  Po 
ElsItXj^)  forallj,  Ic 

State  Estimate  Extrapolation 

Error  Covariance  Exuapolation 

XK(-)  *  d>k-lLElc-l(*) 

Pk(->  =  4.k-l  Pk-l(+)  +  Qk-1 

State  Estimate  Update 

Error  Covariance  Update 

Kalman  Gain  Matrix 

ikf-*)  =ik(-)  +  KkUk  -  Hkik(-)1 

Pk(^)*M-KkHiclPk(-) 

Kk  *  Pk(-)  HkT(HkPk(-)HkT  +  Rkl’' 

(-)  and  {■♦•)  are  used  to  denote  the  times  immediately 
before  and  immediately  after  a  discrete  measurement. 

For  example.  +  )  and  in  the  table  are  equivalent 

to  P{k/tc-1)  in  equation  (6-7). 


Several  quantities  in  equations  (6-3)  thiouqh  (6-7)  are  of 
particular  interest.  The  vector  H(k)x(k/lc-1)  in  equation  (6-6) 

IS  called  the  predicted  measurement, and  its  difference  with  the 
actual  measurement,  given  by 

y(k)  -  H(k)x(k/k-l)  (6-8) 

IS  called  the  innovation.  Ihis  vector  is  often  used  for  testing 
for  filter  divergence  or  for  data  editing. 

The  matr i x 

H(k)P(k/k-1)H'’’(k)  +  R(k)  (6-9) 

in  equation  (6-5)  is  considered  the  covariance  matrix  of  the 
innovations  and  is  usually  chosen  to  be  one-d imens i ona i ,  namely, 
a  scalar,  in  the  following  manner,  'if  only  one  measurement  is 
input  at  time  tj^,  then  in  equation  (6-2)  ^(k)  is  a  scalar.  h(k; 
nas  only  one  row.  and  y(k)  is  a  scalar.  The  matr  ix  (6-9)  is  then 
a  scalar,  whatever  the  size  of  Pfk/k-l).  If  more  than  one 


6-6 


measurement  is  available  at  time  t^.,  it  is  usually  more  economi¬ 
cal  in  computer  time  to  process  each  measurement  individually, 
since  matrix  inversions  are  avoided..  Hence,  the  first  measure¬ 
ment  used  wou  I  o'  be  preceded  by  a  time  update  (equations  (6-3)  and 

(6-4).  (The  estimate  £  and  the  estimate  error  covariance  matrix 
P  being  is  updated  from  time  t|^_^  to  time  tj^ .  (equations  (6-3) 
and  (6-4))  The  other  measurements  at  time  t|^  would  not  need  a 
time  update,  so  only  equations  (6-5),  (6-6),  and  (6-7)  would  be 

used  with  the  old  x(k/k-1)  and  P(k/k-r)  of  the  previous  step 
being  replaced  in  each  equation  by  the  new  ones. 

As  mentioned  before,  for  a  Kalman  filter  with  linear  models 
and  the  assumed  noise  statistics,  the  order  in  which  ail  the 
measurements  at  time  t|^  are  processed  is  not  significant.  Most 

importantly,  processing  the  measurements  i  nd  i  /  i  dua I  I y  will  give 

the  same  output  as  processing  them  together  in  a  measurement 
vector  if  there  is  no  cross  correlation  among  the  measurements  at 
time  t|^.  Usually  this  is  the  case  or  at  least  can  be  assumed 
true  with  a  minimum  of  error. 

The  preceding  equations  will  easily  yield  a  computer  program 
which  IS  a  working  Kalman  filter.  The  problem  remains,  however, 
to  make  sure  the  filter  does  the  job  for  which  it  was  intended. 
Once  written,  the  filter  must  be  subjected  to  extensive  simula¬ 
tion  testing.  Testing  is  necessary  to  detect  moaeling  errors, 
statstical  assumption  errors,  inappropriate  initial  conditions, 
biases,  correlated  noise  sequences,  and  finally  to  determine 
tuning  value. 

F  I  I tei  tuning  is  the  process  of  achieving  the  best  possible 
estimatiu.  p  sr  ormance  from  a  filter  once  its  structural  form  has 
been  specified.  In  a  Kalman  filter,  the  structural  form  is 
specified  by  the  matrices  G,  and  H.  The  initial  estimate 
error  covariance  matrix  P(0),  the  model  error  covariance  matrix 
Q,  and  the  measurement  'loise  covariance  matrix  R  are  the  vari¬ 
ables  modified  during  tuni'-'-g.  The  use  of  Q  and  R  is  normally 
based  on  the  knowledge  of  w  (the  system  model  error)  and  v  (the 
measurement  noise).  These  vectors,  w  .and  v,  account  for  actual 
noises  and  disturbances  in  the  physical  system  as  well  as  inade¬ 
quacies  in  the  dynamic  and  measurement  moaeis. 

6.2  The  Llnaar  Continuoua  K«lm«n  Filter 

For  a  linear  continuous  Kalman  filter,  start  with  the 
dynamic  model 


£(t)  =  F(t)><(t)  +  G(t)w(t) 
ano  the  measurement  model 


(6-  I  0) 
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^(t)  =  H(t)x{t)  +  ^(t) 


(6-11) 


with  initial  values  x{0)  and  P(0),  where  w{t)  and  v{t)  are 
zero-mean  white  noise  processes  uncorrelated  with  x(0)  and  have 
covariance  matrices  Q(t)  and  R(t)  (see  table  6-2). 


TABLE  6-2.  SUMMARY  OP  CONTINUOUS  KALMAN  FILTER 

EQUATIONS  OJIIHITE  MEASUREMENT  NOISE) 

1 

Syilcm  MbJel 

i(ii  =  F(i)i(ti  ♦  C(t)a(0,  »(it'  Niji.  oiiw 

Mcjj,iucnici)t  Model 

i(t)  -  ll(t)i<t)  *  v(t),  v(t)-  Slid,  R(l)> 

Initial  Coiiditiunt 

EIxlO)!  =  xo.  t|(4(0)  -  £o)  (*(0>  -  io)’*')  '  Po 

Odicr  Astump'ions 

R''(t)  existi 

State  Estimate 

£<i)  =  F<t)A(t)  ♦  K(t)U.(t)  -  H(l)l(l)) ,  >(0)  *14) 

Efiof  Covanance  Piopagation 

h)  =  F(l)P(t)  ♦  P(t)FT(i)  ♦  G(t)Q(t)GT(i) 

-K(l)R(l)KT(t).  P(0)  =  Po 

k'almjn  Gain  Matnx 

K(l)  =  P(t)HT(t)R*’(t>  whenE|s(l)tT<T)J  -0 

=  lP(t)HT(t)tC(l)C(t))R"‘(l) 

when  E(s(t)xT(T))  «  C(t>i(i  -  r) 

Then  the  filter  equations  are 

x(t)  =  F{t)x(t)  +  K{t)l_i^(t)  -  H(t)x(t)].  (6-12) 

and 

P(t)  =  F(t)P(t)  +  P(t)F''’(t)  +  G(t)Q(t)G'^^T.i  -  K(t)R(t)K'''(t) 

(6-13) 


w  i  th 


K(t)  =  [P(t)H''‘(t)  +  G(t)C(t)J  R"’(t)  (6-14) 

where  E(w(t)y^(s)1  =  C(t)3(t-s),  with  E  representing  the  expected 
value  and  6,  the  Dirac  delta  function.  The  three  equations 
comprise  one  recursive  step  in  the  continuous  Kalman  filter 
a  I gor i thm. 
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The  problem  is,  in  part,  to  solve  P(t)  in  equation  (6-13). 
whi'-;h  is  known  as  the  “matrix  Riccati  equation."  (Reference  2 
gives  methods  for  solving  this  equation.)  Then  plug  P(t)  into 
equation  (6-14)  to  solve  for  K(t),  which  is  used  ;n  equation 
(6-12)  to  obtain  the  final  desired  result  x(t)  for  a  particular 
recursive  step.  (See  refere.ice  2  for  further  discussion.) 

6 . 3  Extended  Kslmsn  Ft  I  fra 


An  extended  Kalman  filter  is  a  data- process i ng  algorithm 
which  IS  based  on  the  Kalman  filter  algorithm  and  which  effi¬ 
ciently  provides  estimates  for  nonlinear  problems.  Such  filters 
are  suboptimal  because  no  theoretical  optimal itv  of  the  estimate 
can  be  proven.  Either  or  both  of  the  given  models  (continuous  or 
discrete,  otherwise  known  as  "dynamic"  or  "measurement")  of  a 
Kalman  filter  may  be  nonlinear  for  an  extended  Kalman  filter  to 
be  required.  The  extended  Kalman  filter  is  still  a  linear 
algorithm,  however. 

For  an  extended  Kalman  filter,  assume  the  dynamic  model  is 
x(t)  =  jf(x(t),t)  +  G(x(t)  ,  t)w(t)  (6-15) 


with  initial  conditions  x(tQ)  and  P(0)  =  cov  lx ( t^) , x ( tQ) i ,  where 
w(t)  IS  a  zero-mean,  Gaussian  noise  vector,  such  that 
cov  iw(  t)  ,w(s)  i  =  Q(t)6(t-s),  and  cov  (><  ( tQ)  ,  w  ( t )  i  =  0  for  t  >  tQ. 
The  notation  cov  i . , . )  represents  the  covariance  matrix  of  the  two 
vectors.  The  6  is  the  Dirac  delta  function.  The  vector  ^  is  a 
nonlinear  function  of  the  state  vector  x(t)  and  of  the  time  t. 
Notice  that  the  model  (6-15)  is  not  completely  general  since  the 
dynamic  noise  is  assumed  additive. 

The  measurement  model  is  given  by 

j^(t(^)  =  (x  ( t,^)  ,  t(^)  +  v(t|^),  k  =  0,1,...,  (6-16) 

where  y(t(^,)  is  the  zero-mean  measurement  noise  vector,  with 

cov  iy  ( t(^)  ,  V  ( t|^) )  =  R(k),  cov  {y(t|^)  ,y  (t  j )  )  =  0.  cov  (x  ( tQ)  ,y  ( t,^)  )  = 

0,  and  cov  (w(t)  ,y(t|^) )  =  0. 

Note  that  the  measurement  model,  though  nonlinear,  is  still 
discrete  since  the  measurements  are  taken  at  discrete  times. 

Also  assume  the  initial  values  £(0)  and  P(0)  are  given. 

Then  the  extended  Kalman  filter  update  from  the  measurement 
at  time  tj^.  to  the  measurement  at  time  t|^^^  is  accomplished  in  the 
f o I  lowing  manner : 

(1)  The  state  vector  update’ is  achieved  by  using  the 
vector  function  ^  of  equation  (6-15).  Thus,  the  equation 
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x(t/t|-)  =  jf  (x  (t/tj,)  ,  t) 


(6-17) 


IS  integrated  for  tj.  <  t  <  i  ,  resulting  in  x(t/t(^). 


(2)  The  matr i x 


6f (x(t) ,t) 


(6-18) 


F  ( X  ( t )  ,  t ) 


i 21  ( t )  =  ^  1 1/  t|^) 


IS  ca I cu I ated . 


For  the  rest  of  the  chapter,  F(2i(t),t)  will  be  denoted  F(t), 
_f{2i(t),t)  will  be  denoted  jf,  and  21<t)  will  be  denoted  >1  for  the 
sake  of  convenience. 


(3)  The  transition  matrix  calculated 


us  I  ng 


(6-19) 


=  F  ( t  )•  ( t ,  t  f ) 


where  t,^  <  t  <  tj^^  ^  and  'S  the  identity  matrix, 


(4)  The  state  noise  covariance  matrix  Q*  is  calculated 


us  I  ng 


-^k+l 

J  ♦  (t,^^,  .t)G(t)Q(t)G'^{t)*''’(t|^^,  .t)dt.  (6-20) 


(5)  The  measurement  matrix  H(t|,,+  ^)  is  calculated  by 


(6-21) 


Hd,..,)  =  — 


IX  -  ]  /  tj^)  . 

where  £(tk+i/t|^)  was  obtainea  in  step  (1). 

The  update  is  not  ready  to  be  performed.  To  obtain  the  gain 
matrix  i''(t|^^^),  first  extrapolate  the  state  covariance  matrix 
using  equation 

,t^)P(t^/t^)^'’’(t^^i  ,t^)  +  0*(t^+.).  (6-22) 


•k+1  '  '■k^'^'’-k'  '■k 


k+1  ’  '•k' 
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Then 


(6-23) 


The  state  update  is  then 

=  i(t^+,/t,^)  +  K(t,^^.,)  [^(t;^^,)  -  h(x(t,^^l/t^)  .  t^)]. 

(6-24) 

Equation  (6-24)  gives  the  desired  update  at  time  To  com¬ 

plete  the  filter  update,  compute  the  state  covariance  matrix  at 
time  t|^^^  by 

^P^^k+1''^k^  •  (6-25) 

where  I  is  the  appropriately  sized  identity  matrix. 

Further  modifications  of  the  basic  Kalman  filter  equations 
are  possible  and  often  necessary  for  the  proper  functioning  of  a 
Kalman  filter.  If  the  noise  vectors  are  not  zero  mean,  the  state 
vector  may  be  expanded  to  solve  for  bias  estimates.  If  the  noise 
sequences  are  not  white,  shaping  filters  may  be  used.  If  the 
noise  statistics  are  unknown,  adaptive  estimation  schemes  may  be 
added  to  determine  these  statistics.  If  computer  word  length 
affects  the  numerical  stability  of  the  filter,  square  root  type 
filters  can  be  written.  The  literature  is  filled  with  such 
Kalman  filter  applications  and  more  are  being  added  every  de.y  as 
Kalman  filters  are  used  to  solve  harder  and  harder  problems. 

A  disadvantage  of  the  extended  Kalman  filter  is  that  the 
Kalman  gain  and  the  error  covariance  update  matrix 

P  ( t|^+ ^  p  must  be  computed  in  real  time.  They  cannot  be 

precomputed  before  the  measurements  are  col lected  and  stored  in 
computer  memory  as  can  be  done  when  using  the  basic  Kalman  filter 
because  K(tj^+p  and  P  ( tj^+ ^  / 1|^^  ^  are  both  dependent  on 
£^^ic+ 1 '' t|<;)  .  in  equations  (6-23)  and  (6-25),  it  is  seen  that 
H(t|^+,)  IS  needed  to  calculate  K(t|^+i)  and  P  ^  ,  / 1)-  + ^  )  . 

H(t|^^^),  given  in  equation  (6-21),  is  dependent  on  x  ( tj^^  ^  /  tj^ )  . 
H(t^,+  ^)  is  actually  shorthand  for  H  (x  ( t|^^^ /tj^)  )  .  Needed  is  the 
estimate  update,  and  hence  the  measurements  themselves,  to  cal¬ 
culate  the  Kalman  gain  and  the  error  covariance  update. 

After  the  extended  Kalman  filter  is  designed,  a  "sensitivity 
analysis"  is  sometimes  performed.  A  sensitivity  analysis  com¬ 
prises  a  set  of  analyses  to  determine  the  sensitivity  of  the 
filter  design  to  any  possible  differences  between  this  suboptimal 
filter  and  a  filter  that  fits  the  optimal  mold  exactly. 
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References  1  and  2  discuss  solutions  to  several  of  the 
problems  mentioned  in  the  preceding  paragrriphs.  Since  the 
discussion  here  was  limited  to  conventional  real-time  Kalman 
filters,  the  reader  may  also  wish  to  consult  '^^ferences  1  and  2 
for  a  state-of-the-art  exposition  on  post-fiight  Kalman  smooth¬ 
ers  . 


A  simple  example  will  illustrate  an  extended  Kalman  filter 
as  described  in  paragraph  6.3.  A  moving  target  is  tracked  by  N 
stations,  each  measuring  at  times  t|^.  k=1,2,...,  m,  the  distance 
of  |he  target  from  the  station.  Estimate  the  target's  position 
and  velocity  at  time  tj ,  1<j<m,  using  all  the  range  measurements 
up  to  and  including  those  at  time  tj . 

In  this  example,  the  state  vector  x(.t)  is  chosen  to  be  the 
six-vector  consisting  of  the  position  and  velocity  of  the  target 
in  a  geocentric  coordinate  system,  so 
»  ■ 
x(t) 
y(t) 

x(t)  =  2(t)  (6-26) 

vx  ( t) 
vy  ( t) 

.  V2(t)  . 


The  continuous  dynamic  me  si  corresponding  to  equation  (6-15)  is 


x(t)  =  _f(x(t))  +  G(x(t))w(t) 

where 

• 

vx  (  t) 
vy  (t) 

V2(t)  ,  G(><(t)) 

0 
0 

0 

and 

ax  ( t) 

w  ( t )  =  ay  ( t) 

az  ( t) 


0  0  0 
0  0  0 

0  0  0 

1  0  0 
0  1  0 

0  0  1 


(6-27) 


(6-28) 


(6-29) 
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where  ax,  ay,  and  az  are  Gaussian  white  noise  enors.  Thev  can 
also  be  considered  geocentric  components  of  taroLft  acceleration. 
Of  course,  ^(x(t)),  G,  and  w(t)  could  have  been  assigned  other 
values  to  satisfy  equation  (6-27).  In  real-life  situations, 
however,  the  vf.iMes  assigned  to  G,  and  w  are  as  given  above. 

The  initial  conditions  x(tQ)  and  P(0)  are  assumed  to  be 
provided  before  time  t^.  A  simple  (and  usually  inadequate) 
method  is  to  take  three  ranges  prior  to  time  t^  and  triangulate 
to  get  x(tQ),  y(ty) ,  and  2(tQ)  and  set  vx(tQ)  =  vy(tQ)  =  vz(tQ)  = 
0.  The  6x6  matrix  P(0)  can  be  chosen  to  be  diagonal  with  values 
on  the  main  diagonal  to  reflect  the  filter  designer’s  confidence 
or  lack  thereof  in  the  method  of  determining  £(tQ).  (Generally, 
the  greater  the  confidence,  the  larger  the  values.) 

The  matrix  Q(tJ  where  cov , iw(t) ,w(s) I  =  Q{t)6(t-s)  *s 
assumed  to  be  1 3 .  where  I3  is  the  3x3  identity  matrix  and  is 
chosen  to  compensate  for  unmodeled  accelerations.  The  value  of  <j 
may  be  determined  by  subsequent  tuning  studies. 

The  measurement  model  is  given  in  equation  (6-16)  as 

Y(tj^)  =  jh(x  ( T|^)  ,  t)^)  +  v(t|^). 

For  this  example,  the  vector  is  N-d imens 1 ona I  consisting  of 

the  N  ranges  available  at  time  tj^.  For  any  i,  I^i^N,  the  1  th 
component  of  h (x  ( tj^)  ,  tj^)  is  "" 


1  (x(t,^)  -  X,)^  +  <y(t^)  -  Yj)2  +  (zft^)  -  2,)2  (6-30) 

where  x  ( tj^)  ,  and  z(t|^)  are  components  of  the  state  vector 

at  time  tj^  and  (X|,  Yj,  Zj)  is  the  location  of  the  i  th  tracking 
station  in  geocentric  coordinates.  The  matrix  R(k)  =  cov 
( V  ( t|^)  ,  v  ( t|^)  I  is  assumed  to  be  diagonai  with  main  diagonal 
element  1,  equal  to  the  expected  variance  of  the  measure¬ 

ments  provided  by  the  i th  ranging  station. 

The  measurements  in  this  example  are  going  to  be  processed 
individually  as  described  in  paragraph  6.1.  Hence,  for  each  tj,.  , 
there  are  N  measurements  to  process  which  satisfy  the  scalar 
equat i on 

y|(t^)  =  h,{x(t,^))  +  v,(t,^),  I  =  1,2 .  N.  (6-31) 

where 


n^CxIt^))  =  1  ”  ^i^^  ^  “  ^1^^  ”  ^1^*^  ■ 

(6-32) 
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The  matrix  Rj(k)  =  cov  { ,  ( t|^)  ,  v ,  { is  then  a  scalar. 

Now  proceed  with  the  steps  described  in  paragraph  6.3. 

These  steps  describe  the  quantities  needed  to  estimate  the 
position  and  velocity  of  the  target  at  time  t|^+^  ,  given  the 
estimate  at  time  t|^,  and  the  measurements  at  time  I  . 

(1)  The  equation 

£lt/t|^)  =  JftB(t/t|^))  (6-33) 

must  be  integrated  vor  t|^  <  t  £  ^k+t  9®^  xft/tj^).  According 
to  equation  (6-27),  equation  (6-33)  is  written  out  as 
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or 


^<^k  +  l  ■  ^k^  •  (6-40) 

Similar  computations  yield  y(t|^+^/t|^)  and  z  ( t|^^.  ^  / 1(^)  .  (6-41) 


Thus,  the  state  vector  time  update  equation  is 


■  t 

^^^k+1/(=k) 

xftk/tk)  +  vx(t„/t,^)  (tj^^l  -  t^), 

y(tk+i/tk) 

y(t^/t,^)  +  vy(Vt^)  (t;^^,  -  t^) 

z(tk+l/tk) 

= 

£(tk/tk)  +  vz(t^/t^) (t^^,  -  t^) 

v'x  (tu/ti.) 

vy(tk^.i/tk) 

^  ^  ^  . 
vy(tk/tk) 

vMtk/tk) 

(2)  The  next  step  is  to  compute  tne  matrix  F(t)  of 
equation  (6-18).  Using  equation  (6-27),  the  i,jth  eiement  of  the 
matrix  F ( t )  is 


^1 

dx  i .! 


a  (f) , 

a  (x)  j 


1< i , j<6 , 


evaluated  at  x  =  x(t/tj^)  .  For  1<i<3  and  1<j<3, 

a(  f.)  j  avx  (t) 

-  is  of  the  form - , 

a(>i)  j  dx(t) 


(6-43) 


(6-44) 


which  is  zero,  since  velocity  is  not  dependent  on  position. 


For  1<i<3  and  4£J<6,  if  i  ^  j  , 
a(f)  i 

-  is  of  the  form 

j 

wh i ch  IS  zero .  If  i  =  j  , 

a(i)  j 

-  is  of  the  form 

a(x)  j 


avx(t) 

avy  (t) 

avx(t) 

avx(t) 


(6-45) 


(6-46) 
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which  is  1.  For  4£i<6  and  all  j, 
9(1)  i 

- -  a  0 

9(X)  : 


(6-47) 


Hence , 


F(t)  = 


0  0  0  10  0 
0  0  0  0  1  0 

0  0  0  0  0  1 

0  0  0  0  0  0 
0  0  0  0  0  0 

0  0  0  0  0  0 


(6-48) 


(3)  The  next  step  is  to  compute  the  transition  matrix 
#  according  to  the  matrix  differential  equation  (6-19)  which  is 

d  •  ( t ,  t  ^) 

-  F(t)#(t.t^^) 

at 

where  <  t  5  and  ♦tT|^,t-)  is  the  6x6  identity  matrix  Ig. 

The  solution  to  equation  (6-19)  is 


F(t)dt 


•<^k+1'^k>  =  ® 


*  *6  ^ 


F(t)dt  +  1/2 


F(t)dt  +  .  .  .  . 


(6-49) 


Then,  since 


F(t)dt 


6-16 


(6-50) 

(4)  The  next  calculation  is  equation  (6-20)  to  obtain 
the  state  noise  covariance  matrix  Q*.  To  evaluate  equation 
(6-20),  compute  the  product  ♦(t|^^^  ,  t)  6  (t)  Q(t)  G' ( t)#^  ( t|^^^  ,  t)  . 
Recall  that  in  defining  the  dynamic  model,  it  was  assumed  Q(t)  = 
0^13.  Furthermore,  the  matrix  G  may  be  partitioned  as  O3  1  , 

'3 

where  O3  is  the  3x3  zero  matrix.  Then 
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(6-5 1 ) 


Then,  i f  D  *  ^k+i  "  then 

♦  ,  t)G(t)Q/t)G''’(t) 


a'^Dl 


I 


'3 

Dl  3 

*^3 

03 

'3 

O3 

0 

/T  *"  * 

a  .3 

and 


,  t)  G  (t)Q(  t)G^  ( ^^k+1  • 


(T^Dls 


'3 

^3 

D  1  Q 

1  <3 

a^D^la 

0^  DI3 

cr^D  1  ^ 

1  -3 

(6-52) 

To  evaluate  equation  (6-20),  the  integrals  of  the  four  blocks  of 
the  partitioned  matr i x  (6-52)  are  calculated.  For  every  nonzero 
element  in  the  block  c^D^lo. 


fk+l  -'■k+1 

J  cr^O^dt  =  J  d2 


=  <J 


r 


k+ 


^^k+l"  -  2t,^+it  +  t-)dt 


■  "^^^^k+l^t  -  t^  +  it^  +  t^/3) 


k+l 


■K+ ) 


=  -  tk+l"^k  -  '^k+l®  ^  ^  -  t,^3/ 
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(6-53) 


=  ^k+1^k^  -  ^k®/3) 

=  £^(tk+l  -  ^k^^- 
3 


Hence , 
t 


J 


k+1 


a^D^lg  dt  =  -  tj^)3l3 


(6-54) 


S  im  i  I  ar  I  y , 


I 

/ 


k+1 


<72013  dt  =  -  tj^)2|3  , 


and 


J-k+l 

J  cr2i3  dt  =  <T2(ti^^^ 


V)'; 


3  • 


(6-55) 


Thus , 


QMt^^l)  =  cr2 


(1/3)(tk^1-tk)^l3 


( 1  /2)  I3 


(1/2) 


'*k*r'K’  '3 


r 


(6-56) 


(5)  This  step  defines  the  measurement  matrix  for  the 
measurements  at  time  t|^+^  •  In  processing  the  measurements  indi¬ 
vidually,  for  each  there  are  N  matrices  H|(t|^^.^),  i  =  1 . 

N.  Each  Hj  is  defined  by  equation  (6-21)  as 


ah  i 

Hj(tk+i)  =  -  (6-57) 

ax 

X  =  X  (t,^^.,/t,^)  . 


where  hj  is  defined  in  equation  (6-32)  and  x  (t|^^j/t|^)  was  ob¬ 
tained  in  step  (I).  The  matrix  Hj  is  defined  bv  equation  (6-57) 
to  be  1x6.  The  first  component  of  Hj  is 
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dh 


3x  ( t) 


a  (  N  (x(t)  -  X|)2  +  (y(t)  -  \  +  (r(t)  -  2  ,2, 


Sx  ( t) 


X(t)  -  X; 


N  (x(t)  -  Xj)^  +  (y(t)  -  Yj)2  +  (2{t)  -■  2j)2 
which,  evaluated  at  £  ( ^  /  tj^)  is 

N  /t|,)  -Xi)2  .  -Y|)2  +  -Z,  )2 

(6-58) 

Similar  calculations  can  oe  made  for  y  and  z.  Since  hj  is 
not  a  function  of  vx ,  vy ,  or  vz,  then 


(6-69) 


dh, 

dh  I 

dh, 

a 

a  0  for  i 

*  1 . N. 

dvx 

dvy 

dv2 

Hence ,  i  f  r 

denotes 

the 

denominator 

of  equation  (6-58), 

measurement 

matrix 

H|.  i 

i  *  1 .  N, 

is 

ni<*k*i>  =1 


(x(tkt,/tk)-X|)  (y(tu,.,/tu)-Yi)  (k<t^+,/t|,)-Z|)  0  0  0 


(6-60) 

Now  a  I  I  the  values  have  been  obtained  that  are  needed  to 
update  the  estimate  of  the  position  and  velocitv  of  the  target  at 
time  given  the  estimate  at  time  t^,  and^tne  measurements  at 

time  Assuming  that  the  initial  values  ^(tQ)  and  P(0)  are 

given,  then  the  following  sequence  will  give  the  l^alman  filter 
for  this  example.  This  sequence  can  be  used  to  write  the  filter 
program,  in  FORTRAN  for  example,  with  steps  (1)  through  (5)  as 
subroutines  which  are  called  at  the  appropriate  times  in  the 
sequence . 
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First,  extrapolate  the  state  vector  using  equation 

(6-42) in  step  (1).  Also  extrapolate  the  state  covariance  matrix 
P{t|^/t|^)  using  equation  (6-22).  For  this,  l<t,^+,,t|^)  is  needed 
from  step  (3)  and  from  step  (4). 

The  data  at  time  is  input  as  an  N-vector  ^(t|^^^). 

However,  process  the  measurement  from  each  station  individually. 
To  do  so,  process  them  in  sequence  by  considering  each  measure¬ 
ment  Yj,  1=1,..., N  as  a  one-dimensional  measurement  vector.  Then 
go  from  Vj  to  Yj  +  i  in  a  similar  manner  as  going  from  ^(tj^)  to 
Once  the  calculations  of  all  the  Vj’s  have  been  com¬ 
pleted,  the  measurement  vector  for  time  will  be  known,  which 

is  designated  as 

^(t|,.+  p  =  (yp  yg .  y^)  .  (6-61 ) 

Now,  begin  the  sequence  of  measurement  updates  for  time  with 

Yf 


The  gain  matrix  is  computed  using  equation  (6-23).  The 
matrix  from  step  (5)  is  used  here.  Note  then  that  the  result¬ 
ing  K(t(^^p  will  be  the  first  of  N  gain  matrices,  denoted 
i  ^  ^k+ 1  ^  '  ‘  ~  1  ,  .  .  .  ,N  and  that  they  are  all  6x1, 

The  measurement  update  of  equation  (6-24)  is  then  completed 
for  the  one-dimensional  vector  yp  using  y,  as  the  y(t,^+,)  of 
equation  (6-24),  and  plugging  h  ^  (^(  t|^.^  ^  / 1|^)  )  from  equation  (6-32) 
into  the  t •  ^k^  equation  (6-24).  The  output 

^k+ I /tk+1 )  designated  as  ft  ^  ( t,^^  ^  /  tj^^  p  to  indicate  its 

calculation  from  measurement  yp  The  covariance  matrix  is  also 
updated,  using  equation  (6-25)  and  resulting  in  |  ,  / 1^^  I )  . 

Only  the  last  three  steps  consisting  of  gam  calculation, 
measurement  update,  and  covariance  update  are  repeated  for 
measurements  ^2’  Ygt  •  •  •  >  V(\j*  No  time  update  is  needed  because 
these  measurements  are  all  at  the  same  time  as  y p  Thus,  for 
measurement  y2 .  t|e+ 1 is  replaced  in  equation  (6-24)  by 
X  ( tk+ 1  /  tk+ 1  ^  ^^^k+l'^^k^  is^replaced  in  equations  (6-23)  and 

(6-25)  by  ( T|^+ 1  / f l^+ 1 )  >  since  and  are  the  best  estimates 

currently  available.  The  output  of  equation  (6-24)  will  then  be 
X2  (tk+^ /tk+1  ^  that  of  equation  (6-25)  will  be  P2  ^  ^k+ 1 ^k+ 1  ^  • 

These  three  steps  are  repeated  until  ^  ,  /  tj^^  I )  is  obtained 

which  IS  the  estimate  of  the  target’s  position  and  velocity  at 
time  t|^^^  given  ail  the  measurements  up  to  and  including  those  at 
time  t|^+p  and  P|\j  ^  T|<;+ 1 ^ )  which  is  its  corresponding  covari¬ 
ance  matrix.  The  updates  have  now  been  completed  for  the  (k+1)®^ 
time  point. 
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CHAPTER  7 


FILTERS  IN  CURRENT  RANGE  USE 


This  chaptsr  contains  a  description  of  some  of  the  most 
frequently  used  filters.  The  filters  sar.';pled  from  the  survey 
provide  a  good  cross-section  of  range  data  applications,  and  no 
attempt  has  been  made  to  select  a  filter  which  is  best  for  any 
application.  There  are  seven  least  squares  filter  applications 
in  use  identified  by  the  survey,  and  probably  several  more  that 
were  not  identified.  Discussion  of  several  variations  of  the 
least  squares  filters  is  given  in  this  chapter.  Also  discussed 
is  the  Quadratic  Digital  (QD)  filter  which  has  been  in  use  for 
many  years,  and  at  the  time  of  the  survey,  there  were  five  QD 
users.  The  originator  of  the  QD  filter  Is  Mr.  W.  A.  McCoo I , 

White  Sands  Missile  Range  (WSMR) .  A  section  on  the  Digital 
Filter  X  (DFX)  is  included  to  provide  support  for  the  QD  filter. 

Appendix  A  contains  a  summary  of  filter  information  based  on 
a  survey  of  the  Data  Reduction  and  Computer  Group  of  the  Range 
Commanders  Council.  The  appendix  essentially  contains  all  of  the 
information  received.  In  addition,  the  appendix  provides  areas 
of  application  used  at  the  contributing  ranges  and  observations 
about  the  suitability  of  the  filters. 

7 . 1  Least  Squares  Filters 

There  are  numerous  filters  based  on  least  squares.  In  this 
section,  one  basic  and  most  widely  used  least  squares  filters  is 
the  least  squares  polynomial  moving  arc  filter.  Although  the 
si.mple  average  filter  is  not  usually  recognized  as  a  type  of 
least  squares  filter,  it  is  addressed  here.  The  least  squares 
methods  described  throughout  the  rest  of  the  chapter  are  varia¬ 
tions  of  the  least  squares  polynomial  moving  arc  filter. 

7.1.1  Simple  Moving  Average  Filters 

Simple  moving  average  filters  give  the  average  of  the  N  most 
recent  observations  and  are  equivalent  to  fitting  a  zeroth  degree 
polynomial  evaluated  at  the  midpoint.  The  formulation  is  quite 
elementary:  it  is 

xt  +  x^_i  +  ••• 

=  - - -  (7_,) 

N 


=  M. 


^‘t  - 


t-1 


N 
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This  filter  is  very  simple  and  straightforward  and  is  useful  for 
observing  a  constant  process.  However,  if  the  process  is  chang¬ 
ing,  a  small  value  of  N  is  needed  for  rapid  response. 

The  foliowing  is  an  explanation  of  a  simple  moving  average 
filter  as  a  least  squares  filter.  It  is  assumed  that  the  average 
is  a  constant  value  (call  it  a)  expressed  in  terms  of  the  parame¬ 
ter  in  consideration  (call  it  x) .  The  problem  starts  out  with 
the  simple  equation 

X  =  a  ( 7-2 1 

The  problem  now  is  to  find  the  value  for  a  so  that  the  N 

data  points  . x^  collectively  deviate  from  equation 

(7-2)  as  little  as  possible  (in  the  least  squares  sense).  Then, 
to  find  the  best  least  squares  estimate  for  a  over  the  last  N 
values  of  x,  the  value 


S  =  i  (x,-a)2 

i =t-N+) 


(7-3) 


must  be  minimized. 

Taking  the  partial  derivative  of  S  with  respect  to  a, 

t 

=  2  £  (Xj  -  a)  *  0  (7-4) 

i=t-N+l 


as 

da 


It  can  be  seen  that  S  is  minimized  when 
t 

£  X I  =  na  (7-5) 

i  =  1 

from  which  it  is  found  that  the  best  least  squares  estimate  for  a 


I 


t 


I  X 

t-N+1 


I 


N 


(7-6) 


the  average  value  of  the  parameter  at  the  most  recent  N  points. 

7.1.2  fast  Squaras  Polynomial  Moving  Are  Filters 

Least  squares  polynomial  moving  arc  filters  are  based  on  the 
assumption  that  the  true  function  can  be  expressed  over  a  finite 
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span  of  time  by  a  polynomial  of  fairly  low  degree  and  tnat  the 
errors  in  the  measurements  are  random  with  zero  mean  and  finite 

rms  value  r.nd  are  serially  uncorre  i  ated .  Noted  here,  the  smaller 

the  time  intervals  are,  the  less  the  degree  the  Dolynomial  needs 
to  be  to  provide  a  good  estimating  curve  for  the  data.  A  sam¬ 
pling  interval  of  .05  seconds  is  said  to  be  sufficiently  small 
for  good  data  fitting.  It  is  desired  to  solve  for  the  coeffi¬ 
cients  of  the  polynomial  which  best  fits  the  data  in  a  least 
squares  sense,  that  is,  to  minimize  the  sum 

S  =  I  (a^  +  a,ti  +  a2t2  +  ...  +  a^t^  -  v,)“  (7-7) 

i  =  l  '  ' 

where 

aj^ ,  k  =  0,  1 . d  are  the  coefficients  of  the  polynomial  of 

degree  d 

t|  =  time  of  each  sample  referenced  to  the  midpoint  of 
the  span  under  consideration. 

Yj  =  sampled  measurements 

n  =  number  of  points  in  the  span  (constrained  to  be  odd 
and  greater  than  d) . 

To  minimize  S,  take  the  partial  derivatives  of  S  with  respect  to 
each  of  the  unknowns,  a|^,  and  solve  the  resulting  set  of  d+1 
linear  equations.  In  matrix  notation,  write  this  as 

CA  =  B.  where  (7-8) 

r  i+J-2 

C  is  composed  of  Cj:  =  tj^  ,  i  =  l,  2,...,d+l, 

k=  1  j -  1 ,  2 ,  .  .  . , d+ 1 

A  =  (a^,  a  ,  ,  .  .  .  ,  a^)  ^  ,  and 

n 

B  IS  a  vector  with  elements  b,  =  £  .  i  =  l,  2,...,d  +  l. 

k=1 

Then  A  =  C~^B.  If  the  polynomial  Sq  +  a^t  +  a^t^  +  ...  + 
reoresents  position,  then  velocity  and  acceleration  are  found  by 
taking  the  derivatives  of  the  polynomial  with  respect  to  time. 

The  vector  A  of  coefficients  has  been  found  for  the  first  n 
time  points.  Normally,  the  polynomial  with  these  coefficients  is 
applied  just  to  the  midpoint  of  the  time  span.  The  first  (n-l)/2 
points  are  generally  used  just  for  finding  the  new  data  value  for 
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tha  midpoint,  but  new  values  may  be  generated  (using  that  poiyno- 
mial)  for  the  first  (n“1)/2  points  also.  Once  the  new  midpoint 
data  vaiue  has  been  found,  the  next  step  is  to  redetermine  the 
coefficients  of  the  polynomial  using  points  2  to  n+l,  so  a  new 
data  value  for  the  new  midpoint  can  be  found.  Repeat  this 
process  until  finished  with  the  polynomiai  moving  from  points 

m . m+n-1  to  m+1 . m+n  with  each  step  (where  m  ranges  from  1 

to  the  total  number  of  time  points  minus  n) ,  thus  describing  a 
moving  arc. 

if  the  data  are  sampied  at  equally  spaced  intervals  of  time, 
the  t  can  be  considered  to  be  unity  and  C~  is  uniqueiy  deter- 
minad  when  d  and  n  are  chosen.  By  use  of  C"'  and  tj,  a  set  of 
weights  can  be  computed  for  determining  the  a|^  such  that 

n 

^  “^ki^N-n+i,  <7-9) 

i  =  1 

N  is  the  subscript  of  the  last  point  in  the  span. 

These  weights  are  useful  for  determining  the  expected  error  in 
position,  velocity,  and  acceleration  for  data  with  known  input 


n 

(  I  Wu|2) <72,  (7-10) 

i  =  1  ^ 

it  is  assumed  that  the  standard  deviations  of  aii  the  measure¬ 
ments  yj  are  the  same,  and  it  is  called  <7^.  Thus  the  sampling 
intervai  can  be  chosen,  as  welt  as  the  number  of  points  smoothing 
and  the  degree  of  the  poiynomial  which  wiii  accomplish  the 
desired  results,  with  a  minimum  expense  of  computational  effort 
(see  reference  3).  There  are  methods  of  calculating  C~<  that  do 
not  entaii  finding  the  inverse  directly,  which  would  be  very 
time-consuming.  One  of  these  methods  will  be  discussed  later  in 
this  chapter. 

An  advantage  of  using  a  polynomiai  is  that  much  need  not  be 
known  about  the  true  process,  because  if  the  polynomial  is  of 
high  enough  degree,  it  will  tend  to  seek  out  the  signal  in  the 
presence  of  noise  and  give  a  reasonable  estimate  of  it.  For  this 
reason,  the  higher  degree  of  the  polynomial,  the  more  flexibility 
is  allowed  in  accurately  constructing  the  true  process.  Another 
reason  is  by  using  least  squares,  the  polynomial  is  not  forced  to 
pass  exactly  through  any  of  the  observations,  which  would  result 
in  a  certain  amount  of  smoothing. 


error  since 
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7.2  Position  and  V/sloolty  Constrstnsd  Loast  Squaras  PI  I  tars 

Position  and  valocity  constrainad  least  squares  filters  are 
based  on  the  philosophy  that  the  beat  estimate  of  the  true 
function  and  its  derivatives  can  be  obtained  by  fitting  a  polyno** 
mial  to  fixed  time  spans  of  the  measurements  by  the  method  of 
least  squares  while  Imposing  constraints  on  the  polynomial  which 
force  continuity  between  successive  spans.  The  assumptions 
concerning  the  data  are  the  same  as  for  least  squares  polynomial 
filters,  but  the  additional  requirement  is  made  that  the  polyno¬ 
mial  being  fit  to  the  filter  span  must  pass  through  a  point  on 
the  previous  curve  with  the  same  slope.  For  example,  consider 
fitting  a  quadratic  to  data  sampled  at  evenly  spaced  Intervals. 
Suppose  there  are  five  points  in  the  span,  that  the  midpoint  of 
the  span  is  at  t^O,  and  that  each  point  in  the  span  is  one  unit 
apart  from  the  one  next  to  It.  For  the  first  span,  the  time 
values  are  t|,  isi,...,5  where  tj»  i-3.  It  would  be  desirable 
to  have 

9i  »  So  +  a,ti  +  a2t2  (7-11) 


evaluated  at  1^3  to  be  the  filtered  data  value  for  the  midpoint. 
Thus,  the  filtered  data  value  Is  equated  with  Sq ,  since  t3  -  0. 
Once  Sq,  ap  and  33  for  this  span  have  been  solved  for  using  the 
regular  least  squares  method,  the  first  step  is  completed. 

The  next  step  is  to  solve  for  9>  at  t|  *  1.  Move  the  span 
one  point  over  so  that  the  new  span  is  for  points  1=2,..., 6.  The 
new  midpoint  is  at  1=4.  Remember  there  are  two  constraints: 
position  and  velocity.  Note  now  that  t^  is  the  middle  time  value 
for  the  new  span.  The  idea  of  the  filter  is  that  the  polynomials 
of  both  spans  have  the  same  value  (position)  and  the  same  slope 
(velocity)  at  time  t^. 

For  both  the  old  and  new  spans,  consider  the  middle  time 
value  to  be  0  and  the  following  time  value  to  be  1.  So  for  the 
old  time  span,  t3  =  0  and  1^=1.  For  the  new  time  span,  t3  =  -1, 
t^  *  0 ,  and  tg  =  1 .  Let 

p(t4)  =  ^0  *  *i^4'’’  ®2^4  (7-12) 

be  the  polynomial  for  the  midpoint  of  the  new  span,  and  let 


ao  +  ait4  +  a2t4 


(7-13) 


be  the  polynomial  for  the  same  point  of  the  old  span.  Use  the 
position  constraint  to  obtain  and  the  velocity  constraint  to 
obtain  a'. 
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7.2.1  Position  Conatraint 


Because  p(t^)  is  for  the  midpo I nt  of  the  new  span,  the 
method  equates  t^  to  0,  so  that  p(t4)  takas  on  the  value  aQ. 
Because  q(t4)  Is  for  the  point  to  the  right  of  the  midpoint  of 
the  old  span,  the  method  equates  t^  to  1,  so  that  q(t^)  assumes 
the  value  aQ  +  a^  +  a2.  To  ensure  that  these  two  polynomials 
have  the  same  value  at  t^,  equate  a^  wi  th  Sq  a2.  Now  the 

value  has  been  found  for  the  first  coefficient  for  the  new  span. 

7.2.2  Va 1 00 1 IV  Constraint 

Again,  consider  the  polynomial  p(t^)  for  the  midpoint  of  the 
new  span.  The  slope  for  this  polynomial  is  a^'  -*■  2a2t4.  Because 
this  slope  is  for  the  mIdpo I nt  of  the  new  span,  the  method 
evaluates  this  slope  at  t4  ■  0,  whence  the  slope  takes  on  the 
value  a(.  Also  consider  the  polynomial  qft^}  for  the  same  point 
of  the  old  span.  The  slope  for  this  polynomial  is  a^  +  2m2t^. 
Because  this  slope  is  for  the  midpoint  of  the  old  span,  the 
method  evaluates  the  slope  at  t^i ,  whence  the  slope  assumes  the 
value  a^  +  2a2.  To  ensure  that  the  slopes  of  these  two  polyno¬ 
mials  have  the  same  value  at  t^,  we  equate  a<  with  a^  +  2a2.  Now 
the  value  has  been  found  for  the  second  cosfrlcient  of  the 
polynomial  for  the  new  span. 

So  from  the  position  constraint, 

Sq  *  ao  +  ai  +  ag 

and  from  the  velocity  constraint, 

Sf  a  a^  +  2a2. 

Now  proceed  to  find  the  value  for  82- 
Start  by  minimizing  the  sum 

N  ^  ^  ^  ^  A 

S  =  E  (aQ+a^t+a2tj  -  yj)^  (7-16) 

i =N-n+ 1 

where 


Sq ,  a^ ,  and  82  are  coefficients  for  the  second  span 

n  =  number  of  points  In  the  span  (should  be  odd  and 
greater  than  2;  in  this  case,  n-5) 

N  =  subscript  of  last  point  in  the  span  (in  this  case, 
N=6) 


(7-14) 

(7-15) 
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t,  =  time  of  each  sample  referenced  to  tne  midpoint  of 
the  span  such  that  t,  -  t|_^  =  1 

V,  s  sampled  measurements. 

Taking  the  partial  derivative  of  S  with  respect  to  the  unknown, 
a2.  equating  it  to  zero,  and  solving  for  a^  gives 

/  «  2  •'«3 

a2®  \  {Eyjtj-aQltj-a,Et,'.  (7-17) 

77 

I 

Similarl,'  to  the  first  span,  the  filtered  data  va  i  ue  for  the 
midpoint  o^  the  second  span  is 

A  *  ''  2 

y ,  =  ao  +  a^t j  +  a2t j  17-10) 

evaluated  at  i  =  4.  That  is,  equate  the  filtered  data  value  with 
aQ,  since  t4  *  0 .  The  subsequent  steps  are  done  in  the  same 
manner  as  the  second  step.  Sometimes  it  is  desirable  to  con¬ 
strain  position  only  to  be  obtained  from  the  previous  fit.  In 
this  case  both  a^'  and  a^  In  equation  (7-16)  are  unknown,  and  the 
solution  would  involve  two  aquations  with  two  unknowns. 

This  method  has  a  distinct  computational  advantage  over 
unconstrained  least  squares,  because  there  are  fewer  summations 
and  simpler  equations.  It  also  produces  smoother  output  because 
of  Its  recursive  nature.  However,  it  is  slower  to  react  to  a 
change  in  the  input  and  under  certain  conditions  results  in 
oscillation  in  the  output. 

7 . 3  Orthogonal  Po  I  vnom  I  a  I 

in  smoothing  data  by  the  usual  method  of  least  squares,  it 
IS  necessary  to  choose  in  advance  the  degree  of  oolynomial  which 
will  be  used  to  approximate  the  data.  This  choice  is  necessary 
because  the  coefficients  found  are  dependent  upon  the  degree  of 
curve  oe I ng  fitted.  Often,  however,  it  is  not  known  in  advance 
what  degree  curve  will  best  fit  the  data.  In  such  a  case,  it  is 
desirable  to  fit  several  polynomials,  each  time  increasing  the 
degree  used,  until  it  is  seen  that  any  further  increases  would 
not  produce  a  significantly  better  fit.  The  comoutation  of 
successive  polynomials  is  greatly  simplified  bv  the  use  of  the 
orthogonal  polynomial  procedure.  This  method  determines  the 
approximating  polynomial  in  terms  of  another  variable,  so  chosen 
that  each  coefficient  found  is  independent  of  the  others,  making 
It  possible  to  increase  the  degree  of  curve  used  without  making 
It  necessary  to  recompute  the  previously  found  coefficients. 
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This  program  Is  ganerally  used  to  smooth  position  data.  The 
degree  of  curve  fitted  is  Increased  until  an  F-test  Indicates 
that  additional  coefficients  of  the  polynomial  vwould  not  be 
significantly  different  from  zero.  The  smoothed  positions  are 
then  differentiated  to  obtain  velocities,  and  the  velocities 
differentiated  to  obtain  accelerations.  The  error  estimates  of 
the  smoothed  data  and  derivatives  are  computed  in  the  form  of 
standard  deviations  for  each  point.  Coefficients  of  the  original 
polynomial  are  derived  In  terms  of  the  new  polynomial.  Orthogo' 
nal  polynomials  are  discussed  in  reference  46.  The  method  is 
given  here.  First,  the  term  "orthogonal  polynomials"  Is  defined. 

Two  polynomials  Pj (x)  and  Pj (x)  (of  degrees  i  and  j)  are 
orthogonal  on  a  set  of  points  x^,...,Xp  provided  that 


n 

£ 


k«1 


Pi(x,^)Pj(x^) 


0 


for  I Sj . 


(7-19) 


Given  a  polynomial  of  order  k.  k  orthogonal  polynomials  can  be 
found  whose  linear  combination  expresses  the  original  polynomial 
The  method  of  orthogonal  polynomials  follows.  Assume  that  the 
po I ynomi a  I 


p(t , )  = 


ao  +  a^t,  +  a2t,  + 


^  “k^i 


(7-20) 


expresses  tho  true  function.  Reference  46  shows  directly  and  by 
example  that  this  polynomial  may  be  re-expressed  as 


p  (t  i )  = 


*^0^0' 


+  b,P 


r  1  't 


+ .  .  .  + 


b,P 


2^2' 


where  PQ.tj  *  1 


Pi  .t,  »  t, 

Pj , t  i  -  ^ i Pj - 1  ,  i 


Qj-2 


'’j-2,  I 


where  Q:  =  £ 


(7-21 ) 
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The  time  variable  t|  ranges  from  -(N-1)/2  to  (iM-l)/2  in  steps  of 
one.  {The  index  i  could  have  been  used  instead  of  t^,  but  t  is 
the  more  conventional  variable  for  time.)  Reference  46  shows 
that  the  P;  's  are  orthogonal  to  each  other. 

j  .  t  i 

Once  the  original  polynomial  of  equation  (7-20)  has  been  re¬ 
expressed  in  terms  of  orthogonal  polynomials  (in  equation 
(7-21)),  p(t)  can  be  expanded  to  be  of  one  more  degree  through 
the  Gram-Schmidt  or thogona I  I zat i on  process, 

where 


n 

X  P j  (X|^)  Pj  (X|^)  is  the  inner  product  and  (7-22) 


where  the  polynomials  Pj(x)  and  Pj (x)  are  vectors  in  the  vector 
space  of  polynomials  spanned  by  1 , x , x^ , . . . , x^ ,  where  n  is  the 
degree  of  the  higher  degree  polynomial.  In  this  manner,  the 
values  of  any  of  the  previously  obtained  hj's  or  Pj  ^'s  are  not 
changed.  instead,  another  such  term  is  merely  aadei^  on. 


At  what  degree  should  expanding  stop?  Reference  46  suggests 
a  clever  criterion  for  deciding  when  to  stop.  The  variance  V  of 
the  data  can  be  expressed  in  the  following  two  ways: 


V  =  (T, 


(N-1)/2  k  i 

r  <£  -  y|)2 

i=-(N-1)/2  j=1  ' 

N  -  1  -  k 


V  = 


Qj(bj  -  Bj) 


(7-23) 


where  bj  is  the  computed  coefficient  and  Bj  is  the  true  coeffi¬ 
cient.  'Reference  46  gives  the  derivations  for  the  last  two 

2  2 

equations.  Of  course,  Og  =  a^,  but  two  different  notations  are 
given  for  the  sake  of  future  reference.  The  object  now  is  to 
te« '  the  hypothesis  that  the  true  value  of  the  jth  coefficient  Bj 
IS  zero.  Test  the  hypothesis  using  an  F-test.  (The  F-test  tests 
the  proportion  of  two  variances.)  Test  the  prooortion. 


Bj=  0 


(7-24) 
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2 

Of  course,  the  numerator  Ojj 

this  proportion  should  be  close  to  1. 
I n  the  test ,  I  f 


Q:b‘ 


B.>0 


I  f  B  j  is  i  dea  My  0 ,  then 


2 

^b 


<  F. 


(7-25) 


2 

‘^a 

then  the  hypothesis  is  accepted  as  true,  and  bj  is  set  equal  to 
zero.  The  next  coefficient  is  tested  in  the  same  mahner.  When 
two  consecutive  coefficients  are  set  equal  to  zero,  then  the 
degree  k  of  the  polynomial  Is  determined  from  the  last  coeffi-* 
dent  which  was  not  set  equal  to  zero;  that  is,  k=J*‘2. 

Stopping  after  two  consecutive  zero  coefficients  assumes 
that  succeeding  terms  in  the  polynomial  will  carry  negligible 
weight.  For  practical  purposes,  most  parameters  can  be  modeled 
using)  a  lower-order  polynomial.  If  the  polynomial  Is  of  higher 
degree,  the  higher  coefficients  are  close  to  zero.  Normally, 
data  generally  does  not  shoot  up  or  down  suddenly  enough  to 
warrant  higher  degree,  high-magnitude  coefficients. 

7.4  Least  Squares  Poivnomiai  Moving  Arc  Fitters  Using  Recurs ive 
Sums 


A  recursive  scheme  for  computing  the  sums  required  to 
perform  least  squares  polynomial  moving  arc  smoothing  has  been 
developed  at  the  Air  Force  Development  Test  Center  which  permits 
this  type  of  smoothing  to  be  accomplished  considerably  faster 
than  by  the  usual  linear  combinations  of  observations.  This  is 
not  a  recursive  filter  in  the  usual  sense  in  that  previous  filter 
output  is  not  used  in  determining  current  output. 

In  paragraph  7.1  it  was  stated  that  the  equation  for  this 
type  of  smoothing  may  be  written  in  matrix  notation  as 

A  =  C"’b,  (7-26) 

where  the  elements  of  A,  B,  and  C  have  been  previously  defined. 
Each  element  of  B  and  C  consists  of  a  summation  of  n  terms  (n  = 
number  of  points  smoothing)  which  must  be  performed  each  time  a 
point  Is  dropped  and  another  is  picked  up  in  the  moving  arc 
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process.  However,  these  summations  can  be  avoided  by  computing 
the  sums  for  a  given  span  in  terms  of  those  for  the  previous 
span . 


For  instance 
discussed  in 

,  suppose  it  was  found  that  through  the  method 
paragraph  7.1 

(1) 

n  j_^  ,  "  "’’n+l  * 

^  ^k  ^k  2 

k=1 

(7-27) 

where  T 
i  nterva 

j  is  the  i  time  value.  So  tj^  is  the  length  of  the 

1  between  the  k^^tlme  point  and  the  midpoint  of  the 

sp  0  . 

To  find 

b  j 

(2) 

n+ 1 

E  yL.  -  A)  ,  where  A  =  ^n-*-3  -  ^n+1 

k=2  2  2  * 

(7-28) 

do  so  in  terms  of  b; 


(1  ) 


by  means  of  the  recursion 


b  , 


(2) 


i-1  (1)  i-l 

=  I  (-A)J  ('“b  b  =  _j  +  y  +1  E  (-A)-* 
j=0  •*  j=0 


-  Vi 


(-AP 


C>-1  ) 


t 


i-j-1 

1 


-  j  - 
n  + 


(7-29) 


The  elements  of  C  are  computed  similarly  by  considering  the  y)^= )  • 
However,  as  previously  stated,  if  the  data  are  evenly  spaced,  C 
is  uniquely  determined  when  the  degree  of  the  polynomial  and  num¬ 
ber  of  points  smoothing  have  been  selected.  In  this  case,  C" 
can  be  precomputed  and  stored  for  use  in  the  smoothing.  In 
addition,  A  can  be  considered  unity,  and  the  equations  for  the 
recursion  are  simplified. 


With  this  formulation  no  lengthy  summations  are  required  and 
the  number  of  operations,  once  initiated,  is  independent  of  the 
number  of  points  used  in  the  smoothing.  Furthermore,  by  comput- 

2 

I  ng  recursively  reference  63  shows  that  with  very  little 

extra  effort  the  residual  sum  of  squares  of  each  span  can  be 
obtained  as  an  estimate  of  the  error  in  the  data  by 


s 


(7-30) 


7-11 


7 . B  PTlvtlv  Information  RaoovTV  by  a  S«l«ctlva  Infgratlon 
TachniQUtt  (DIRSIT) 


The  data  smoothing  technique  knotwn  as  Derivative  Information 
Recovery  by  a  Selective  Integration  Technique  (DIRSIT)  was 
developed  in  1962  at  White  Sands  Missile  Range.  The  technique 
has  been  modified  somewhat  to  permit  more  control  of  interval 
program  parameters  to  satisfy  the  requirements  of  a  greater 
number  of  users.  The  basic  steps  In  the  DIRSIT  smoothing  philos¬ 
ophy  are 

(1)  the  sign  of  the  difference  between  the  raw  and 
smoothed  position  data  is  examined  at  each  point  within  the 

f  i  I  ter  span ; 

(2)  the  smoothed  position  data  is  satisfactory  if  the 
number  of  positive  signs  differs  from  the  number  of  negative 
signs  by  one;  (The  total  number  of  signs  is  odd.)  and, 

(3)  if  (2)  above  is  not  satisfied,  the  acceleration 
history  within  the  filter  span  is  modified  as  much  as  necessary 
to  force  the  difference  to  one. 

It  is  assumed  that  sampled  position  data  is  being  entered 
with  associated  time.  The  output  is  smoothed  position,  velocity, 
and  acceleration  with  associated  time.  For  the  filter  span  2m-*-1, 
which  is  odd,  table  7-1  shows  a  starting  condition. 


TABLE  7-1.  A  STARTING  CONDITION  FOR  A 
FILTER  WHOSE  SPAN  IS  2m+1 

DIRSIT 

PO 1  NTS 

Raw  Position 

Smoothed  Position 

Vs  1 oc i ty 

Acca 1  erst  1  on 

•  » 

•  •  1 

^2 

^2 

Xm+  1 

Xm+1 

'^2m+l 

•  • 

^2m+1 
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The  parameters  x^,  x^.  Xj,  i=1,...,2m+l  are  generatea  during 
initialization;  consequently,  the  initial  estimates  are  obtained 
independently.  Columns  X|  and  Xj  are  computed  as 


-  -  .  2 
Xj  +  i  =  Xj  +  Atj..^X|  +  (1/2)  A  tjXj 

^i  +  1  =  Ati^.j*xi 

where  i  =  1 . 2m+1  ;  Atj^j  =  tj^^  -  tj 

All  accelerations  *Xj,i*m+1 . 2m+l  are  equal. 


(7-31 ) 

(7-32) 


Having  completed  the  columns  of  table  7-1,  examine  how 
closely  the  smoothed  and  raw  positions  agree.  Generate  m  values 
of  xi  by  computing  AXj  =  Xj-  Xj,  i =m+ 1 , . . . , 2m+ 1 .  Hence,  the 
number  of  negative  Ax |  and  the  number  of  nonnegative  Ax j  cannot 
both  be  odd,  neither  can  they  both  be  even.  Let  NL  be  the  number 
of  Axj  which  are  negative;  that  is,  the  Tc  j  is  larger  than  the  x,. 
Let  NS  be  the  number  of  Axj  which  are,  nonnegat  i  ve .  NL  +  NS  =  m 

and  the  Ax j  (i=m+2 . 2m+1)  are  acceptable  if  I  NL-NS  I  >3* 

These  conditions  are  corrected  by  changes  in  the  Xj  , 
i =m+ 1 , . . . , 2m+ 1 ,  which  will  also  produce  changes  in  the  Xj  and  Xj, 
I =m+2 , . . . , 2m+ 1 . 


Examine  the  procedure  for  changing  the  x 
assume  that  NS  >  NL  +  3;  then  the  Xj  must  be  increased, 
at  some  time  t,  the  acceleration  wi I i 


To  be  spec i f J  c , 


‘■m+1 

times  tp,  t„+2' • • ■ 
stant.  This  type 


•P’ 


be  increased  with 
the  pivot  Doint. 


'^2m+1  acceleration 

of  increase 


change  in  only  one  X|^ 
former  I y 


negat i ve  where 
equate 


so 
i  t 


ncr ease 
in  acceleration  will 
that  Axj^  wou  I  d 
was  nonnegative 


Star  t i ng 
s i ope  1 . 
Then  for 
be  con- 
result  in 


Ax|^  as  shown  in  the  following  equation: 


will 
just 

just  barely  become 
The  first  step  i s 


to 


Ax|^  =  (1/6)  (tp-t) 


(1/2)  (tp-t)2(t,^-tp) 


+  ( 1  /2)  (t. 


■t)  (tj^-tp) 


(7-33) 


Note  that  the  change  in  distance  is  obtained  by  a  double  integra¬ 
tion  of  acceleration.  First  integration  of  figure  7-1  would 
yield  a  velocity  curve  of  the  shape  shown  in  figure  7-2. 
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Figure  7-1.  Example  accelera- 
t i on  curve  , 


Figure  7-2.  Corresponding 

velocity  curve . 


Where  Area  A  =  (  1 /6)  ( tp- 1)  ^  ,  Area  B  =  ( 1 /2)  ( tp- 1 )  ^  ( t,^-tp)  , 
and  Area  C  =  ( 1 /2)  { tp-t)  ( t|^-tp)  ^  (7-34) 

Ax^,  =  (1/6)  t(tp-t)®  +  3(tp-t>^  (t|^-tp)  +  3  (tp -t)  (t^-tp)^] 

(7-35) 


=  (1/6)  (  (t^-t)2  -  (t,^-tp)3) 

from  which  ( tp“'t)  =  (6Ax,^  +  (t,^-tp)3  (7-36) 

Thus,  equation  (7-36)  gives  the  distance  between  t-  and  tp.  This 
change  made  in  x^  and  the  changed  Xj^  would  decrease  NS  by  1  and 
increase  NL  by  1.  For  each  positive  Axj  ,  compute  a  tj  but  only 
the  largest  t^is  used.  Thus  only  one  Ax j  would  change  sign.  For 
this  selected  value  of  t,  the  changed  x j ,  Xj,  and  X|  are  calcu¬ 
lated  for  each  time  beyond  A  check  is  made  again:  if 

NL-NS<1  ,  then  the  output  at  t,  of  x,  k,  ??,  is  the  output  of 
D I RS I T ;  if  NL-NS>I,  the  above  computation  of  t  is  repeated. 

Suppose  that  NL  ^  NS+3  or  that  the  number  of  negative  Axj  is 
three  or  more  greater  than  the  number  of  nonnegative  Ax^  .  Under 
these  ccnditions  equation  (7-36)  becomes 

(  p-t)  =  [-6Ax,^+(t,^-tp)  -  (t,^-tp)  (7-37) 
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To  this  point  it  has  been  assumed  that  t< t ^ ,  when  t>t^ 
another  procedure  is  employed.  Increase  the  slope  of  the  accel¬ 
eration  as  shown  in  figure  7-3. 


T  >  1 


Figure  7-3.  Example  acceleration  curve  for  t  >  t^ 


T  = 


6u^k 


<'k  -  -  <«k  - 


(7-38) 


With  this  new  value  of  T  the  new  Xj,  Xj,  x^,  i=2 . 2m+ 1 

are  calculated.  If  I  NL-NS  I  =1,  the  data  output  is  finished;  if 
not,  repeat  calculation  of  t.  Now  redefine  terms  by  shifting 
their  previous  values  down  one,  that  is,  shift 


^  i  +  1 
-  i  +  1 
^  i  + 1 

i'.i  +  l 

^i+1 


i=2. 


.  ,m 


(7-39) 


The  next  nata  point  is  now  in 
.•■>"00653  IS  reoeated. 


pnt 
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The  DIRS  IT  was  the  original  real-time  flight  filter  at  wGMR 
and  has  been  successfully  used  with  data  from  such  missile 
systems  as  the  Nike  Zeus,  ARPAT,  Pershing,  and  Athena.  The 
filter  has  been  used  for  Nike  Zeus  and  ARPAT  elevation  data,  to 


generate  acquisition  data,  and  to  initialize  a  re-entry  simula¬ 
tion  in  the  Athena's  real-time  operational  program.  It  is  the 
major  filter  being  used  at  Holloman  Air  Force  Base  and  WSMR  to 
evaulate  the  Athena  re-entry  data  and  is  the  prime  source  of 
post-flight  data  for  the  flight  safety  impact  prediction  programs 
at  WSMR.  The  post-flight  data  is  then  used  for  vectoring  recov¬ 
ery  aircraft. 

Because  DIRSIT,  a  self-editing  filter,  uses  a  median-smooth¬ 
ing  criterion,  random  spikes  will  have  no  effect  on  the  filter 
output.  Operation  is  not  dependent  upon  equal  time  increments 
between  data  points,  and  a  missing  or  repeated  data  point  will 
not  cause  problems.  With  existing  subroutines,  numerous  internal 
parameters  can  be  controlled  to  obtain  the  desired  filter  re¬ 
sponses.  However,  D I RS I T  was  not  without  its  problems.  Posi¬ 
tion,  velocity,  acceleration,  and  time  arrays  must  be  stored, 
thus  reouiring  a  significant  amount  of  storage  space  and  comput¬ 
ing  time.  In  addition,  the  filter  has  a  lag  which  makes  it 
undesirable  for  real-time  use.  (For  additional  information  on 
D 1 RST ,  see  references  36  through  39.) 

7.6  DIolf I  Filter  X  (DFX) 

In  1963  at  WSMR,  real-time  flight  safety  support  was  first 
provided  from  the  central  computer  facility.  Originally,  the 
DIRSIT  filter  was  used,  but  it  became  evident  that  DIRSIT  was  not 
a  satisfactory  real-time  filter  because  of  the  excessive  storage 
requirements,  computing  time,  and  inherent  lag.  Consequently, 
the  original  version  of  the  DFX  filter  was  develooed.  The  DFX  is 
3  variation  of  a  constrained  second^degr ee  filter  which  defines 
"best  fit"  criterion  to  be  that  the  algebraic  sum  of  the  differ¬ 
ences  between  the  raw  and  smoothed  data  is  zero. 

The  filter  is  more  efficient  in  both  speed  and  storage 
reouirements  because  of  a  development  which  avoids  computing  the 
constraints  explicitly  and  which  stores  only  the  array  of  differ¬ 
ences  rather  than  arrays  of  both  raw  and  smoothed  data.  Addi¬ 
tionally,  a  mean  rather  than  a  med i an  smoothing  criterion  is 
used.  The  filter  response  is  controlled  by  a  set  of  input 
parameters  which,  in  turn,  determine  the  shape  of  the  accelera¬ 
tion  correction  curve.  The  smoothing  criterion  for  the  DFX 
filter  IS 

N 

S  =  I  (X.-Xj)  =  0 

I  =  ! 

'A'h  i  c  h  I  cads  to 

N  _ 

S  =  I  {X(.  +  Xq  (  i  At)  +  Xq  (ll_At£)  -  X,)  =0  (7-41) 

1  =  1  2 


(7-40) 
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With  the  constraints  Xq  and  Xq  fixed,  only  the  acceleration  has 
to  be  adjusted  with  each  step 

N  .  N 

’'o  •  — -  NXo  -  Xo  At  li  <7-42) 

At^£  1^  i*i  i  =  i 

2 

Equation  (7-41)  differs  from  the  constrained  least  squares  (CLS) 
aquations  only  in  the  multiplying  factor  (i^  At^) ,  and  this 


difference  will  affect  only  the  computation  of  the  correction 
coefficients  used  by  the  filter.  The  method  of  applying  the 
correction  to  the  acceleration  terms  is  the  same  for  both  a  CLS 
and  DFX  f  i  I  ter  . 

To  see  how^this  method  is  dfve i oped . ^ f i rst  look  at  the 
expression  for  Xj^.^  in  terms  of  X^  where  X|^  Is  the  new  data  value 
of  Xj^  rfter  smoothing: 

A 

^i  +  1  *  X,  +  <1  At)  +  X,  (i^  At^)  (7-43) 


2 


(If  Xj^,  were  expressed  in  terms  of  xj,  At  would  be  the  step 
size.  In  this  case,  consider  i  At  to  be  the  step  size.)  Rede¬ 
fine  terms  by  shifting  down  the  values  for  the  next  cycle,  so 
that  Xj^^  of  the  previous  step  becomes  what  will  be  designated  as 
><j  in  the  current  step,  where  the  bar  indicates  "prior  to  apply¬ 
ing  the  correction  factor." 

This  redefining  of  terms  gives  the  following  equation: 


Xj*  Xq  +  Xq  (i  At)  +  Xq  (j^  At^)  (7-44) 

2 

Compare  the  previous  equation  equation  (7-44)  with  the  following 
equation  (7-45),  which  expresses  the  ith  smoothed  point  based  on 
the  constraints. 

A  A 

^i  =  Xq  +  Xq  (i  At)  +  X  (i^  At^)  (’-45) 

2 

Subtracting  equation  (7-44)  from  equation  (7-45) 

A  ^ 

(X,  -  X,)  =  (i^  At^)  (Xq  -  Xq)  (7-46) 

2 
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which  will  be  written  as 

<X,  -  X, )  =  ( At^)  (6Xq)  {7-47) 

2 

or 

Xj  =  Xj  +  (  i^  At^)  <5Xq  (7-48) 

2 

That  is,  the  smoothed  position  at  the  i th  point  equais  the 
position  before  correction  pius  a  constant  factor  depending  only 
on  the  delta  time  increment  and  the  position  of  the  ith  point  in 
the  N  point  span  times  the  correction  to  the  acceleration.  The 
significance  of  this  fact  is  that  if  there  are  predicted  outputs 
and  a  means  of  computing  the  acceleration  correction,  then  there 
is  no  need  to  compute  the  constraints  explicitly  or  save  arrays 
of  both  raw  and  smooth  positions.  Note  that  equation  (7-48)  can 
also  be  written 

(X,  -  Xj)  =  (X,  -  Xj)  +  (i^  At^)  dXo  (7-49) 

2 

or 

AXj  =  AXj  +  (i^  At^)  aXQ  (7-50) 

2 

N 

The  quantity  £  AXj  is  set  to  be  zero  as  the  smoothing  criterion, 
i  ®  1 

A 

The  array  AXj  can  be  used  instead  of  the  two  arrays  Xj  and 
Xj  for  computing  each  cycle.  The  AXj’s,  which  are  the  differ¬ 
ences  between  predicted  and  raw  input  at  each  time  are  saved, 
shifted  down,  and  corrected  after  each  succeeding  computing 
cycle.  As  each  Ax,  is  operated  on  in  successive  computing 
cycles,  it  becomes  numerically  smaller.  Most  of  the  correction 
IS  applied  to  the  Ax  j  at  the  cycle  when  i=N,  the  real-time  span. 
This  factor,  it  will  be  seen,  is  what  makes  the  OD  filter  possi¬ 
ble.  Performance  is  almost  identical  to  second  order  CLS  smooth¬ 
ing;  however^  DFX  requires  much  less  computation  time  and  storage 
regardless  of  the  span  size.  in  addition,  filter  characteristics 
can  be  changed  dynamically  during  flight  to  improve  performance. 
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The  basic  DFX  package  includes  editing,  initialization, 
radar  selection,  and  noise  estimate  routines.  Versions  of  this 
filter  were  used  in  all  WSMR  real-time  programs  for  over  five 
years.  References  40  and  41  are  concerned  with  the  DFX  filter. 

7 . 7  Quadrat (0  Dial f  I  (QD)  FMfr 

The  DFX  equations  can  be  derived  using  the  CLS  smoothing 
criterion.  If  an  approximation  is  made  concerning  the  effects  of 
the  terms  of  the  wums  of  products,  the  necessity  of  even  one 
stored  array  is  eliminated  and  the  second  order  DFX  formulation 
can  be  reduced  to  a  set  of  six  equations.  The  performance  of  the 
resulting  (QD)  filter  is  practically  identical  to  CLS  perfor¬ 
mance,  although  computing  time  is  independent  of  the  filter  span. 
In  reality,  the  QD  filter  span  is  implied  rather  than  actual 
because  no  arrays  are  stored.  The  QD  filter  is  essentially  a  DFX 
filter  which  applies  all  the  corrections  needed  to  the  real-time 
point  only. 

The  QD  formulas  employ  a  pred ict-correct  procedure  using  the 
estimates  determined  for  the  current  given  data  value  evaluated 
in  the  preceding  step.  They  are,  therefore,  said  to  be  recur¬ 
sive.  The  prediction  formulas  are 


(7-51) 

(7-52) 

(7-53) 

(7-54) 


•  • 

-  is  predicted  second  derivative, 

A 

-  second  derivative  estimate  from  preceding  step, 

-  predicted  first  derivative, 

A 

X|^  -  first  derivative  estimate  from  preceding  step, 

^  "  predicted  data  value. 
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A 

-  data  value  estimate  from  preceding  step,  and 

At  -  time  differential  from  preceding  step. 

The  corrections  of  the  predicted  values  are  based  upon  the 
differences  between  the  given  data  and  the  predicted  data  values. 
The  correction  formulas  are 


n+  1 

»  Xn+i+  K,  Ax, 

( 7-55) 

n+  1 

=  X^+i  +  Kg  Ax, 

(7-56) 

‘n+  1 

*  Xn+1  +  Kg  Ax. 

(7-57) 

where 


correction  of  the  predicted  second  derivative, 
correction  of  the  predicted  first  derivative. 


A 

Xp4|  -  correction  of  the  predicted  data  value,  and 

K|,  K2  •  *^3  "  correction  coefficients  which  minimize  the  error  of 
the  estimates: 

Ax  -  difference  between  given  and  predicted  data  values. 

The  functional  relationship  among  the  correction  coeffi¬ 
cients  K^,  ^2,  and  Kg  are  revealed  through  study  of  predicted 
values  obtained  by  use  of  the  second  order  CLS  filter.  In  the 
CLS  filter,  intercept  and  slope  constraints  are  applied  at  the 
oldest  value  end  of  a  given  data  span  M,  so  that  the  polynominal 
fit  to  the  M  data  values  in  the  least  squares  sense  must  also 
contain  the  estimates  of  the  true  value  and  the  corresponding 
first  derivative  at  the  oldest  span  point.  Using  these  con¬ 
straints  in  the  second  order  CLS  filter,  the  predicted  data  value 


and  Its  der i vat i ve 

ser 1 es : 

can 

be 

obta 1 ned 

with  the 

truncated 

Taylor 

^n+1 

A 

• 

■  ^n-M+1 

+ 

MAt 

A 

•• 

^n~M+l ' 

(7-58) 

^n+  1 

A 

^n-M+1 

+ 

MAt 

^n-M+1  * 

(M  At)^ 

^n-M+ 1 . 

(7-59) 

2 
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where  n-M+1  indicates  the  oldest  value  in  the  filter  span,  having 
been  shifted  from^its  position  in  the  preceding  step  of  n-M+2. 
Since  and  are  (because  the  position  and 

velocity  are  constrained),  only  can  be  adjusted  to  maice 

equation  (7-59)  fit  the  M  data  values  in  the  least  squares  sense. 
Let  AX  be  the  required  correction.  Then 

A  A 

Note  that  the  second  derivative  is  constant  across  the  second 
order  CLS  filter  span.  Applying  the  correction  to  equation+lns 
(7-58)  and  (7-59)  holding  and  fixed,  gives  the 

est imates 


'  »«  *  *i<>  '7-6n 

x„.,  =■  ♦  M  .■  (M  At)^  <X„.„.,  -  AX)  (7-62) 

2 

Subtracting  equations  (7-58)  and  (7-59)  from  equations  (7-61)  and 
(7-62)  gives 

A 

^  i  +  M  At  Ax,  (7-63) 

Xp.^^  =  Xp,+  ,  +(M  At)2  AX.  (7-64) 

2 

Comparison  of  equations  (7-60),  (7-63),  and  (7-64)  with  equations 
(7-55),  (7-56),  and  (7-57)  reveals  the  relationship  between  Kp 
K.2.  and  Kg  as  desired.  From  equations  (7-55)  and  (7-60) 

AX  =  K^AX  (7-65) 

Then  from  equations  (7-63),  (7-56),  and  (7-65), 

Kg  =  MAtKi  (7-66) 

and  from  equations  (7-64),  (7-57),  and  (7-65), 

Ko  =  (MAt)2  K,  (7-67) 


In  the  QD  theory,  K.^  is  develooed  as  a  function  of  the  corre¬ 
sponding  CLS  filter  span  M,  that  is, 

=  K, (M)  =  eOM^  1 7-68) 

lOM^  +  33M^  +  23M-6 

(See  reference  46  for  the  derivation  of  this  formula.)  Thus, 
when  M  is  arbitrarily  specified,  the  QD  correction  coefficients 
are  determined  by  equations  (7-66),  (7-67),  and  (7-68). 

in  its  basic  formulation,  QO  can  be  used  as  a  real-time 
filter,  because  the  argument  (or  subscript)  of  the  estimates 
corresponds  to  the  latest  value  accepted  by  the  filter.  On  the 
other  hand,  estimates  can  be  obtained  for  tne  data  value  at  the 
oldest  end  of  the  span  which  are  significantly  oetter  than  the 
corresponding  real-time  estimates.  Such  estimates,  which  are 
often  called  "smoothed"  data,  correspond  to  the  constraints 


computed  in 

the  CLS 

f i 1  ter 

Smoothed  estimates  ai- e 

simply 

obtained  with  a  Taylor  ser 

1 es  expanded  about 

the  rea 

1 -t ime 

est imates  ; 

that  is, 

A 

-^n+l 

■  ^n+1  ~ 

(M-1 ) 

(7-69) 

ft  'i 

^n  + 

(M-1  ) 

(7-70) 

for  the  second  order 

2 

QD  fi 

1  ter  and 

A 

A 

(M-l ) 

(7-71  ) 

+ 

c 

«•>< 

A 

=  i  - 

■^n+1 

(M-1  ) 

^^n+1  ^n+1^ 

(7-72) 

2 

A 

A 

^n+  1 

1 

+ 

c 

<x 

11 

(M-l)At  - 

(M- 1) ^ 

(At)^ 

•  f  • 

^n+  1 

2  12  (7-73) 


for  the  third  order  QD  filter. 

The  QD  filter  achieves  smoothing  effectiveness  almost  identical 
to  that  of  the  comparable  constrained  least  squares  filter 
without  he  usual  array  of  saved  input  data  samples.  The  QD  is 
tne  real-time  filter  used  in  the  majority  of  WSMR  operational 
programs.  References  42  through  45  discuss  the  QD  filter  in  more 
detail. 
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APPENDIX  A 
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APEP 


1 .  Name  or  Acronym 

Advanced  Medium  Range  Air-to-Air  Missile  (AMRAAM)  Parameter 
Estimation  Program  (APEP) 

2.  Contact  Mr.  John  E.  Lindegren 

3200  SPTW/KRTAR 
Eg  I  in  APB,  FL  32B42 
(904)  882-4267 
DSN:  872-4267 

3.  Documentation  Sources 


a.  Bierman,  G.  J.  Factorization  Methods  for  Discrete  Sequential 
Est imat i on .  New  York:  Academic  P,  1977. 

b.  Luenburger,  D.  G.  Optimization  by  Vector  Space  Methcds.  New 
York:  Wi ley,  1969. 

c.  Sorenson,  H.  W.  Kalman  Filtering  Techniques,  Advances  in 
Control  Systems.  Vol.  3,  C.  T.  Leondes,  ed .  New  York: 
Academic  P,  1966. 

4.  Origin  Ball  Systems  Engineering  (formerly  VERAC, 

I  ncor  j-'orated) 

10975  Torreyana  Road,  Suite  300 
San  Diego,  CA  92121 
14  February  1982 

5.  Comments 


Strengths  of  the  APEP  filter  are  described  in  the  following  sub- 
paragraphs  ; 

a.  This  filter  provides  optimally  smoothed  trajectory  estimates 
in  the  same  sense  as  an  extended  Kalman  filter  but  with  superior 
numerical  accuracy  because  of  echelonized  square  root  information 
matrices  with  Householder  orthogonal  transformations  of  augmented 
state  transition  matrices.  In  addition,  the  matrices  are  partitioned 
for  dynamic  and  measurement  bias  states  and  make  expl icit  use  of  the 
block  diagonal  matrix  structure  to  minimize  computation  steps  for  the 
sparse  matr i ces . 

b.  The  forward  filter  cycle  is  slightly  slower  than  the  standard 
Kalman  filter,  but  the  smoother  cycle  (backward  filter  cycle)  is  sig¬ 
nificantly  faster  than  a  standard  fixed  interval  Kalman  smoother. 
Smoothed  estimates  require  only  backward  substitution,  and  smoothed 
covariances  are  generated  with  a  UDU  decomposition  of  the  filter 
state  covariances.  Propagation  of  the  smoothed  square  root  informa¬ 
tion  matrices  doss  not  require  matrix  inversions. 
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c.  The  procedure  for  “folding  in"  new  measurements  using  House¬ 
holder  transformations  to  eche Ionize  the  measurement  augmented  state 
equations  allows  inclusion  of  asynchronous  or  irregular  measurement 
data  rates  without  reinitializing  any  of  the  filter  solutions. 

d.  Trajectory  propagation  using  the  current  filter  estimates  and 
state  transition  matrices  avoids  dependency  on  any  particular  measure¬ 
ment  Input. 

e.  All  kinematic  parameters  are  provided  with  1-sigma  error 
bounds  for  the  estimates,  which  require  propagation  of  the  error 
covariances  for  Indirect  parameter  derivations. 

f.  Data  dropouts  of  short  duration  or  changes  in  the  number  of 
available  instruments  are  accommodated  by  APEP  without  catastrophic 

f I  I  ter /smoother  estimate  errors  or  failures. 

g.  A  review  of  filter  cycle  measurement  residuals  allows  iden¬ 
tification  of  wild  points  for  edit  and  adjustment  of  a  priori  measure¬ 
ment  covariances  used  in  program  input.  (Automatic  edit  may  be 
selected  for  a  multiple  of  the  expected  residual  standard  deviation.) 
Deviations  from  the  measurements  error  model  used  by  the  software  are 
indicated  by  correlated  measurement  residuals. 

Weaknesses  of  the  APEP  are  described  in  the  following  subpara¬ 
graphs; 


a.  If  no  inertial  navigation  system  (INS)  data  are  available  for 
measurement  input,  the  square  root  inverse  filter  (SRIF)  cycle  may 
have  to  be  repeated  to  fine  tune  the  a  priori  filter  measurement  and 
state  noise  covariances  or  to  edit  wild  points  which  seriously  perturb 
the  estimates  in  the  state  propagation  steps. 

b.  The  smoothing  cycle  requires  reversal  of  read  order  for  the 
entire  measurement  interval,  thus  requiring  all  measurement  data  to  be 
stored  on  disk  files  or  other  random  access  storage  media.  The  algo¬ 
rithm  uses  fixed  interval  smoothing.  The  volume  of  data  that  can  be 
processed  at  one  continuous  time  interval  is  limited. 

c.  Data-process i ng  time  is  significantly  longer  than  the  data- 
co I  lection  time  interval  If  T Ime-Space-Pos i t i on- I nf ormat I  on  (TSPI) 
from  several  instruments  and  from  the  inertial  data  are  Included  as 
measurement  inputs  to  the  filter. 

d.  The  present  error  mode i  for  TSPI  instruments  i nc i ude  oniy 
bias  terms  as  the  systematic  error  source.  (The  error  model  does 
provide  for  the  Markov  noise  model.)  For  the  short  time  intervals 
associated  with  air-to-air  missile  flights,  bias  terms  may  provide  an 
adequate  model.  For  longer  time  interva-’*-,  with  large  shifts  in  tar¬ 
get  range  or  angle  relative  to  TSPI  Instruments,  a  more  extensive 
error  model  would  be  required  to  ensure  stationer ity  for  the  measure¬ 
ment  res i dua I . 
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FAST  LEAST  SQUARES 


1 .  Name  or  Acronym 

Least  Squares  Moving  Arc  Polynomial  Using  Recursive  Sums 

2-  Contact  Mr.  John  E.  Lindegren 

3200  SPTW/KRTAR 
Egl In  AFB,  FL  32542 
(904)  882-4267 
DSN;  872-4267 

3.  Documentation  Sour css 

Sterrett,  John  K.  "Manual  for  Moving  Polynomial  Arc  Smoothing." 
Ballistic  Research  Laboratory  Report  840.  Aberdeen  Proving 
Ground:  Ballistic  Research  Laboratory,  1952. 

4.  Origin  Ms.  Martha  D.  Everett 

AFDTC/KRBA 

Egl in  AFB,  FL  32542 

5.  Comments 

The  filter  accomplishes  its  designed  tasks  very  well.  By  chang¬ 
ing  the  time  span  or  the  polynomial  degree  or  both,  the  filter  can 
be  adapted  to  the  trajectory,  and  by  changing  a  single  time  constant, 
the  polynomial  can  be  evaluated  at  the  end  point  for  post-mission  pro¬ 
cessing.  No  knowledge  of  measurement  errors  is  required,  and  the  wild 
point  edit  is  adaptive  oecausa  the  distance  off  the  curve  considered 
defective  is  proportional  to  the  noise  in  the  data  for  the  particular 
time  span. 

This  filter  has  one  weakness.  It  cannot  handle  a  step  function 
properly  and  thus  filter  gives  poor  results  at  missile  booster  igni¬ 
tion,  burnout,  or  similar  occurrences. 
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WEIGHTED  LEAST  SQUARES 


1  .  Name  or  Acronvni 

Weighted  Least  Squares  Smoother 

2.  Contact  Mr.  Mika  Dodgan 

Computer  Sciancas  Corporation 
6545  Teat  Group/ENAC 
Hill  AFB,  UT  84056 
(801)  777-6497 
DSN:  458-6497 

3.  Documentation  Sources 


Mr.  Mike  Oodgen 
Computer  Sciences  Corporation 
6545  Test  Group/ENAC 
HIM  AFB.  UT  84056 

4.  Or  loin  Kentron  I nternat I ona i ,  Incorporated 
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WLSRE  in  MIT026 


1 .  Name  or  Acronym 

Weighted  Least  Squares  Recursive  Estimation  (WLSRE)  contained  in 
Multiple  Instrument  Trajectory  Module  (MIT026) 

2.  Contact  Mr.  Robert  Fierro 

U.S.  Army  White  Sands  Missile  Range 
Attn:  STEWS-NR-AM 

White  Sands  Missile  Range,  NM  68002 
(606)  678-2643 
DSN:  268-2643 


3.  Documentation  Sources 


a.  Fierro,  Robert  and  Carolyn  Nicholson.  "Dynamic  Optimized 
Smoothing  Span  (DYNOS) . "  Analysis  and  Computation  Directorate 
Document.  White  Sands  Missile  Range:  Analysis  and  Computation 
Directorate,  1970. 

b.  Comstock,  D. ,  M.  Wright,  and  V.  Tipton.  "Handbook  of  Data 
Reduction  Methods."  Data  Reduction  Division  Tech  Rept.  White 
Sands  Missile  Range:  Data  Reduction  Division,  1964 

c.  Greene,  Earl.  "Edfil,  A  Routine  for  Editing  and  Filtering 
Data."  Analysis  and  Computation  Directorate  Document.  White 
Sands  Missile  Range:  Analysis  and  Computation  Directorate, 
1977. 

d.  Comstock,  D.  "Introduction  to  Least  Squares."  Analysis  and 
Computation  Directorate  Document.  White  Sands  Missile  Range: 
Analysis  and  Computation  Directorate,  1966. 


4.  Origin  Software  Branch 

Data  Sciences  Division 
Attn:  NR-A 

White  Sands  Missile  Range,  NM  88002 
1970 

6.  Comments 


The  filter  is  embedded  in  several  modules  which  make  up  the  Modu¬ 
lar  Integrated  Processing  System  (MIPS)  of  Data  Sciences  Division.  The 
Multiple  Instrument  Trajectory  Module  (MIT026)  exercises  the  filtering 
process  most  extensively.  With  this  module. 


a . 

b. 

c . 

ponents 


observations  are  rotated  to  a  common  plane; 
observations  are  filter-smoothed; 

a  set  of  predicted  position,  velocity,  and  acceleration  com 
are  obtained; 
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d .  corrections  for  items  such  as  refraction  and  velocity  of 
propagation  are  made; 

e.  initial  editing  is  performed  to  eliminate  observations  that 
have  gross  errors; 

f.  approximate  position  components  are  obtained  using  standard 
we i ghts ; 

g.  weights  are  determined  for  position-related  observations; 

h.  best  estimate  of  position  components  is  obtained; 

i.  final  editing  of  position-related  observations  is  performed; 
(If  any  more  position-related  observations  are  rejected,  steps  f 
through  h  are  repeated.) 

J.  approximate  velocity  components  are  obtained  using  standard 
we  i ghts ; 

k.  weights  are  determined  for  velocity-related  observations; 

l.  best  estimate  of  velocity  is  obtained; 

m.  final  editing  of  velocity-related  observations  are  performed 
(If  any  more  velocity-related  observations  are  rejected,  steps  j 
through  I  are  repeated.) 

n.  approximate  acceleration  components  are  obtained  using  stand 
ard  weights; 

o.  weights  are  determined  for  acceleration-related  observations 

p.  best  estimate  of  acceleration  components  is  obtained;  and 

q.  final  editing  of  acceleration-related  observations  is  per¬ 
formed.  (If  any  more  acceleration-related  observations  are  rejected, 
steps  n  through  p  are  repeated.) 
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M-STATION 


Mr.  Wen-Mi  Liou 
Pacific  Missiia  Test  Center 
Code  3400 

Point  Mugu,  CA  93042 
(80B)  989-7931 
DSN:  351-7931 

3 .  Documentation  Sources 

Liou,  Wen-Mi.  "Square  Root  information  F i i ter /Smoother  for 
Mu i t i p i e-Radar  Tracking."  Tech  Note  3440-02-87.  Point  Mugu: 
Pacific  Missiie  Test  Center.  Mar.  1987. 

4.  Origin  Pacific  Missile  Test  Center 

Code  3400 

Point  Mugu,  CA  93042 
1987 

6.  Comments 

The  square  root  Information  filter/smoother  had  been  designed  to 
merge  measurements  from  different  radars  to  obtain  the  best  estimate 
of  trajectory.  The  measurements  consist  of  range,  azimuth,  elevation, 
and  range  rate  from  radar  tracking  of  up  to  10  radars.  This  filter  is 
a  version  of  the  conventional  nine-state  extended  Kalman  filter  but 
has  a  fundamentally  different  approach  to  the  optimal  estimation  prob¬ 
lem.  The  whole  updating  process  of  the  filter  is  founded  on  numeri¬ 
cally  stable,  orthogonal  transformation  and  preserves  non-negativity 
of  computed  covariances.  An  ad  hoc  procedure  for  adaptive  estimation 
had  been  implemented.  In  the  implementation,  the  user  has  the  options 
to  select  the  time  span  for  smoothing  and  to  apply  more  weight  on  the 
measurements  of  some  of  the  radars.  Real  radar  tracking  data  were 
used  to  test  the  filter/smoother;  the  test  results  were  satisfactory. 
In  the  testing,  100  data  point  smoothing  was  found  adequate;  conse¬ 
quently,  more  data  point  smoothing  provided  no  significant  improve¬ 
ment.  This  finding  saves  computer  computation  time  and  storage.  As  a 
result  of  this  finding,  a  better  divergence  control  method  is  being 
i  nvest i gated . 


1  •  Name  or  Acrbnvm 
M-Stat i on 
2.  Contact 
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PBS  PROGRAM.  M-STATION 


1 .  Name  or  Acronym 

Post  Batch  System  (PBS)  Program,  M-Station 

2.  Contact  Mr.  Wen-Mt  Llou 

Pacifio  Mi  as  Me  Test  Center 
Code  3400 

Point  Mugu,  CA  93042 
(805)  989-7931 
DSN:  351-7931 

3.  Documentation  Sources 

Powers,  W.  "Muitiple  Station  Radar  Solution,  Part  I,  Method  of 
Calculation.''  Tech  Note  3285-581.  Point  Mugu:  Pacific 
Missile  Test  Center.  Sept.  1964. 

Origin  Pacific  Missile  Test  Center 

Code  3400 

Point  Mugu,  CA  93042 
1964 

5.  Comments 

Radar  measurements  are  inversely  proportional  to  estimates  of 
their  standard  deviations.  These  weights  are  fixed  and  cannot  change 
as  the  distance  between  target  and  site  change;  thus,  separate  passes 
are  necessary  during  a  tracking  operation.  The  routine  is  fairly 
robust  to  individual  sits  errors  as  each  observation  is  edited  if  it 
exceeds  a  specified  residual ,  however,  to  work  well  generally,  Indi¬ 
vidual  radar  data  must  be  extensively  pre-edited  for  on  track  (beacon) 
times,  and  bias  errors  should  be  corrected  through  calibration.  The 
procedure  produces  a  nine-state  vector  and  its  covariance  matrix  for 
each  time  point  and,  additionally  can  estimate  individual  radar 
b i ases . 
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PBS  PROGRAM.  DERIVE 


1 .  Name  or  Acronym 

Post  Batch  System  (PBS)  Program,  DERIVE 

2*  Contact  Mr.  Wen-MI  Llou 

Pacific  Missile  Test  Center 
Code  3400 

Point  Mugu,  CA  93042 
(806)  989>7931 
DSN:  361-7931 

3.  Doteumentat Ion  Sources 


Morris,  G.  "Poiynomiai  Smoothing  and  Differentiation  by  Least 
Squares."  Working  Note.  Point  Mugu:  Pacific  Miami ie  Test  Center, 
Code  3442,  1966. 


4.  Origin  Pacific  Missile  Test  Center 

Code  3400 

Point  Mugu,  CA  93042 
1966 


B.  Comments 


This  filter  works  well  if  data  are  we  I  I -approx imited  by  a  given 
quadratic  expression.  The  technique  may  give  poor  estimation  of  end 
points  where  midpoint  computations  are  not  appiied.  The  improved  rate 
estimation  is  being  examined  through  the  PBS  program,  Optimum  Finite 
Impulse  Response  Linear  Phase  Digital  Filter  (OPFILT). 
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PBS  FILTER 


1 .  Wmiw  or  Acronym 

Post  Batch  System  (PBS)  Filter 

2.  Contact  Mr.  Wen-Ml  Llou 

Pacific  Missile  Test  Center 

Code  3400 

Point  Mugu.  CA  93042 
(805)  989-7931 
DSN:  351-7931 

3.  Documentation  Sourosa 

Welch,  M.  Working  Note  3442-22-79.  Point  Mugu:  Pacific  Missile 
Test  Center,  Code  3442,  1979. 

4.  Origin  Pacific  Missile  Test  Center 

Code  3400 

Point  Mugu,  CA  93042 
1965 

5 .  Cownenta 

This  filter  technique  is  superior  to  any  time  domain  method  for 
post-operations  analysis;  however,  the  results  are  poor  when  signal 
frequencies  cannot  be  separated  from  noise  frequencies  or  when  the 
signal  lies  partly  in  transition  zones.  The  usual  end  point  problems 
occur  because  of  the  requirements  for  midpoint  estimation.  One  solu¬ 
tion  to  the  end  point  problem  Is  to  collapse  or  expand  the  data  at  the 
ends,  although  the  small  filter  size  would  result  in  a  wide  transition 
zone.  Response  function  Improvement  is  possible  through  a  computer- 
aided  design  of  filter  weights.  (See  Post  Batch  System  program  Opti¬ 
mum  Finite  Impulse  Response  Linear  Phase  Digital  Filter  (OPFILT).) 
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PBS  PROGRAM.  OPFILT 


1 .  Nina  or  Aoronvin 

Post  Batch  Systsm  (PBS)  Program,  Optimum  Finite  Imputae  Response 
Linear  Phase  Digital  Filter  (OPFILT) 

2.  Contact  Mr.  Wen-Mi  Liou 

Paoifio  Missile  Test  Center 
Code  3400 

Point  Mugu,  CA  93042 
(606)  989-7931 
DSN:  361-7931 

3.  Dbbumentat Ion  Sourcea 

a.  Liou,  Wen-Mi.  "Optimum  Finite  Impulse  Response  (FIR)  Linear 
Phase  Digital  Filters:  Theory  and  Analysis  of  the  Model  lan- 
Parks  Algorithm."  Tech  Note  3442-02-82.  Point  Mugu:  Pacific 
Missile  Test  Center,  May  1982. 

b.  McClellan,  James  A.,  Thomas  W.  Parks,  and  Laurence  R. 

Rabiner.  "A  Computer  Program  for  Designing  Optimum  FIR  Lin¬ 
ear  FI  iters."  IEEE  Trans.  Audio  Electroacoustics.  AU-21.6 
(1973) :  606-26. 

4.  Comments 

This  general  purpose  filter  design  algorithm  is  capable  of 
designing  a  large  class  of  optimum  (in  the  minima^  sense)  finite 
impulse  linear  phase  digital  filters  such  as  low  pass  and  high  pass, 
as  well  as  first  and  second  differentiators.  The  algorithm  can  also 
be  used  to  design  filters  which  approximate  arbitrary  frequency 
specifications  provided  by  the  user.  The  user  has  control  over  the 
sizes  of  transition  bands  and  ripples  in  both  passband  and  stop  band. 
The  sharpening  technique  equipped  with  the  filter  design  algorithm 
further  reduces  the  sizes  of  small  ripples  in  the  designs  of  low-pass, 
high-pass,  and  band  pass  filters  of  any  complexity.  At  the  same  time, 
this  technique  increases  the  sharpness  of  the  frequency  response  in 
the  transition  bands. 
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ATA6AS  KALMAN  FILTER 


t .  Nam«  or  Acronym 

Air-to-AIr  Gunn«ry  Asssssmant  System  (ATAGAS)  Kalman  Filter 

2.  Contact  Mr.  Lee  Gardner 

6521  Range  Squadron/RCP 
Edwarda  AFB,  CA  93523-5000 
(805)  277-2628 
DSN:  527-2628 

3-  Documentation  Sources 

Analytic  Sciences  Corporation.  "Optimal  Estimation  for  the  Air- 

to-Air  Gunnery  Assessment  System,  Final  Program  Review."  Reading: 

Analytic  Sciences  Corporation,  n.d. 

Origin  The  Analytical  Sciences  Corporation 

One  Jacob  Way 
Reading,  MA  01867 
(617)  944-6850 

5 .  Comments 

The  Analytical  Sciences  Corporation  has  a  report  which  describes 
their  evaluation  of  the  filter's  effectiveness.  It  was  concluded  that 
the  filter’s  effectiveness  was  better  but  very  costly  computer  time- 
wise. 
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MOTION  TRACKING  KALMAN  FILTER 


1 .  Name  or  Acronym 

Motion  Tracking  Kalman  Filtar 

2.  Contact  Mr.  Lan  Chlldara 

6645  Taat  Qroup/ENAC 
HI  I  I  AFB,  UT  84056 
(805)  777-8605 
DSN:  458-8605 

3.  Documentation  Sourcaa 


High  Accuracy  Multiple  ObJact  Tracking  Svatam  (HAMOTS)  Computer 
Software  Maintenance  Manual.  Dec.  1979. 

4.  Origin  Masers.  Doug  Troxler  and  Mick  Chaplin 

General  Dynamics 
Electronics  Division 
San  Diego,  California 

5.  Comments 


The  filter  does  not  handle  wild  points  from  input  data  as  well  as 
expected . 


« 
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TEC  TRACKER 


'  •  nr  Aoronvm 

U.£  Army  TEXCOM  Expar imantat I  on  Cantar  (TEC)  Tracker  (formerly 
Combat  Devalopmants  Experimentation  Center  (CDEC)  Kalman  Filter) 


2.  Contact  Or.  Joseph  M.  Weinstein 
Scientific  Support 
Laboratory 
P.O.  Box  100 
Fort  Ord,  CA  93491 
(408)  384-2161 


Ms.  Julie  Lemen 
Scientific  Support 
Laboratory 
P.O.  Box  898 
Jo  I  on,  CA  93928 
(408)  385-2880 


3.  Documentation  Sources 


a.  Weinstein,  Joseph  M.  “Position  Location  Logic."  TEC  Scien¬ 
tific  Support  Laboratory  Document.  Jo  I  on:  TEC  Scientific 
Support  Laboratory,  June  1988. 

b.  Weinstein,  Josep<  and  others.  "Kalman  Filter  User  Manual." 
Revision  I.  CDEC  Scientific  Support  Laboratory  Document. 
Jolon:  CDEC  Scientific  Support  Laboratory,  July  1981. 

4.  Origin 

Kalman  tracking  software  developed  by  General  Dynamics  staff  in 
1971  was  furnished  to  TEC  for  use  with  Range  Measuring  System  (RMS) 
hardware.  The  TEC  has  since  upgraded  tracking  procedures,  logic,  and 
code,  notabiy  around  1976  and  1980  but  especially  since  1987, 

5.  Conwienta 


Descr i pt I  on .  The  TEC  Tracker  provides  three-dimensional  position 
and  V.  locity  of  ground  and  air  players  during  instrumented  fie  id  com¬ 
bat  simulations.  This  tracker  is  comprised  of  a  Kalman  filter  and 
several  other  real-time  routines  which  together  process  ranges  between 
A  and  B  units  (RMS  ranging  and  player  units)  as  well  as  altimeter  and 
other  input.  Post-operation  routines  smooth  and  analyze  tracking  out¬ 
put  and  apply  alternative  tracking  algorithms  to  logged  real-time  input. 

Performance .  The  tracker  meets  TEC’s  main  real-time  need  for 
tracking  as  many  as  100  players  reasonably  well  with  10  meters  hori¬ 
zontal  error.  As  upgraded,  the  tracker  reinitializes  quickly  as 
needed,  does  not  require  time-c lumped  ranges  to  any  given  B-unit,  and 
pref liters  (with  outlier  rejection)  ranges  between  any  given  A,B  pair 
before  using  them  in  the  Kalman  filter. 

Prospects.  The  Kalman  computations  are  intensive  and  must  rely 
on  predictive  modeling  of  ground  and  air  combat  maneuver  dynamics. 
Recent  study  suggests  that  throughput  and  accuracy  may  gain  from 
replacing  the  Kalman  filter  by  e  simpler  routine  which  relies  just  on 
good  quality  measured  inputs,  for  example,  a  linearized  least  squares 
fit  to  the  prefiltered  ranges. 
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DRIFT  TRACKING  KALMAN  FILTER 


1 .  Name  or  Acronym 

Drift  Tracking  Kalman  Filter 

2.  Contact  Mr.  Len  Childers 

6545  Test  Group/ENAC 
Hill  AF5,  UT  84056 
(801)  777-8605 
DSN:  458-8605 

3.  Documentation  Sources 


High  Accuracy  Multiple  Object  Tracking  System  (HAMOTS)  Computer 
Software  Maintenance  Manual.  Dec.  1979. 

4-  Or  lain  General  Dynamics 

Electronics  Division 
San  Diego,  California 
1979 

5.  Comments 


This  filter  has  not  been  used  because  score  pod  equipped  vehicles 
are  not  available  at  Utah  Test  and  Training  Range. 
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EATS  KALMAN  FILTER 


1 .  Name  or  Acrom 


Extended  Area  Test  System  (EATS)  Kalman  Filter 


2 .  Contact  Ms .  L .  W I  I  son 

Pacific  Missile  Test  Center 
Coda  3452 

Point  Mugu,  CA  93042 
(606)  984-8784 
DSN:  351-8784 


3.  Documentation  Sources 

The  General  Dynamics,  Electronics  Division,  System  Controller 
Design  document  for  EATS. 

Any  technical  reference  for  Kalman  filtering. 


4.  Origin  General  Dynamics 

Electronics  Division 
San  Diego,  California 
1978  to  1980 


5,  Conments 

The  EATS  design  requirements  called  for  real-time  state  vector 
estimation  with  accuracy  constraints.  This  six-state  Kalman  design 
provided  the  best  alternative  while  satisfying  design  goals.  Real¬ 
time  accuracies  can  be  improved  with  finer  tuning  capability  which  is 
currently  available  with  tri-level  (low-medium-high)  dynamic  tuning 
parameter.  This  dynamic  tuning  parameter  appears  satisfactory  for 
most  purposes.  Post-operations  accuracy  improvement  techniques  are 
currently  under  study. 
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TRIDENT  KALMAN  FILTER 


1  •  Name  or  Acronym 


Trident  Missile  Tracking  Kaiman  Filter 


Contact  Mr.  Donald  Olson 

Pacific  Missile  Test  Center 
Code  1051 

Point  Mugu ,  CA  93042-6000 
(806)  989-8804 
DSN:  351-8804 


Mr .  Eric  Senor 
Pacific  Missile  Test 
Center,  Code  3442 
Point  Mugu,  CA  93042-6000 
(806)  989-7931 
DSN:  361-7931 


3 .  Documentation  Sources 

a.  Gelb,  Arthur.  Applied  Optimal  Estimation.  Cambridge:  MIT  P, 
1974. 

b.  Olson,  Donald.  "Filter  and  Smoother  for  Trident  Missile 
Tracking."  TP-64.  Point  Mugu:  Pacific  Missile  Test  Center, 
June  1988. 


4.  Origin 

Designed  by  Pacific  Missile  Test  Center  personnel,  the  prelim¬ 
inary  covariance  simulations  of  the  Trident  Kalman  filter  began  in 
1977.  These  simulations  led  to  the  first  operational  version  which 
supported  four  missile  tests  in  the  Pacific  during  1983-1984.  In 
1984,  a  major  redesign  effort  resulted  in  a  more  reliable  and  accurate 
second  version  which  has  supported  13  operational  tests  thus  far. 

5.  Comments 


For  r.ange  safety  redundancy,  the  nine-state  extended  Kalman 
filter  operates  on  two  CDC  Cyber  176  mainframes.  Square-root  filter¬ 
ing  was  found  to  offer  no  advantage  over  standard  covariance  filtering 
in  this  application,  presumably  because  of  the  large,  60-bit  word  size. 
Measurements  consist  of  range  sums  and  range  rate  sums  from  five 
transmitting  stations  operating  20  milliseconds  apart.  In  addition, 
pedestal  angles  at  the  receiving  telemetry  antenna  are  used.  While 
process  noise  is  constant,  the  filter  switches  to  a  lower  value  at 
third  stage  burnout.  Constants  are  also  used  for  measurement  noise 
standard  deviations  and  edit  limits. 

Accurate  initialization  was  found  to  be  crucial  to  filter  per¬ 
formance  throughout  missile  flight.  The  initial  state  estimate  is 
computed  in  a  tangent  plane,  rectangular  coordinate  system.  Ranging 
data  from  three  stations  are  filtered  with  a  recursive,  first-degree 
polynomial  filter,  then  used  to  solve  for  missile  position  and  veloc¬ 
ity.  Because  the  z  component  of  the  ranging  solution  is  inaccurate  at 
low  elevations,  z  position  and  velocity  are  obtained  from  missile 
telemetry.  If  telemetry  is  not  available,  the  scheme  defaults  to  a 
combination  of  nominal  date  and  the  ranging  solution. 
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QD  ~  WSMR 


1 .  Name  or  Acronym 

Quadratic  Digital  (QO)  Filter 

2.  Contact  Mr.  John  Fa  Ike 

U.S.  Army  White  Sands  Missile  Range 
Attn:  STEWS-NR-AR 

White  Sands  Missiie  Ranga,  NM  86002 
(506)  678-3458 
DSN:  268-3458 

3.  Documentation  Sources 


McCool,  W.  A.  "QD-A  New  Efficient  Digital  Filter."  Analysis  and 
Computation  Directorate  Internal  Memorandum  60.  White  Sands 
Missiie  Range:  Analysis  and  Computation  Directorate,  August  1967. 

Origin  Mr.  W.  A.  McCool 

Acting  Director 

Analysis  and  Computation  Directorate 
White  Sands  Missile  Range,  NM  88002 
August  1977 

5.  Cotrraents 


The  quadratic  digital  filter’s  computing  time  is  extremely  small 
and  invariant  with  point  span.  it  achieves  smoothing  effectiveness 
almost  identical  to  that  of  the  comparable  constrained  least-squares 
f i I  ter . 
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QD  -  EGLIN 


Although  this  filter  is  efficient,  extremely  fast,  easy  to  use, 
and  does  not  require  extensive  data  arrays,  its  instabilities  caused 
by  unedited  Mi  id  points  limits  its  use. 


9 
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QD  -  APO  SAN  FRANCISCO 


1 .  Name  or  Acronym 

Quadratic  Digital  (QO)  Filter 

2.  Contact  Mr.  Sonny  Padayhag 

Kantron  International,  Incorporated 
Box  1207 

APO  San  Francisco,  CA  96655 
(805)  236-7994,  Ext.  8-2020 
DSN:  254-2020 

3.  Documentation  Sourcaa 


Real-time  program  (RTP)  or  real-time  Impulse  filter  (RTIF) 
documentat ion. 

4.  CommentB 


This  filter  works  well  for  speedy  execution 
small  periods  of  time  such  as  200  milliseconds, 
well  with  exoatmospher I c ,  ballistic  trajectories 
tions  or  propagations. 


and  extrapolation  of 
It  does  not  perform 
and  long  extrapola- 
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QD  -  YUMA 


1 .  Name  or  Acronym 

Quadratic  Digital  (QD)  Filter 

2.  Contact  Mr.  Robert  Mai 

Yuma  Proving  Ground 
Attn:  STEYP-Mt-TA 
Yuma.  AZ  dS36S 
(602)  328-3295 
DSN:  699-3295 

3.  Ddcumentat ion  Sources 

a.  McCooi,  W.  A.  "QD-A  New  Efficient  Digital  Filter.”  Analysis 
and  Computation  Directorate  Internal  Memorandum  60.  White 
Sands  Missile  Range:  Analysis  and  Computation  Directorate, 
August  1967. 

b.  Mai,  Robert  W.  "The  QD  Filter  in  YPG’s  Real-Time  Laser 
Display  System."  STEYP-MAC  Document.  Yuma:  Yuma  Proving 
Ground . 

4.  Origin  Mr.  Robert  Mai 

Yuma  Proving  Ground 
Attn:  STEYP-MAC 
Yuma,  AZ  85366-9102 
1974 

6.  Conments 


The  quadratic  digital  filter  does  a  much  better  job  of  estimating 
velocity  than  conventional  least  squares  moving  arc  routines.  Compu¬ 
tation  time  is  very  small  and  does  not  depend  on  filter  memory  length. 
This  easy-to-use  filter  is  very  simple  to  put  into  computer  code. 
Filter  response  to  impulse  changes  in  acceleration  is  slow,  that  is, 
approximately  two  to  three  times  the  memory  length  selected,  so  filter 
estimates  are  useful  primarily  during  segments  where  acceleration  is 
minimal.  The  filter  memory  length,  which  determines  the  constant  gain 
coefficients  for  position,  velocity,  and  acceleration,  can  be  adjusted 
to  accommodate  higher  accelerations  but  then  the  noise  on  the  filter 
estimates  increases.  Perhaps  the  major  drawback  of  the  QD  filter  is 
the  difficulty  in  determining  accuracy  of  velocity  estimates  which  is 
dependent  upon  the  complex  interaction  of  sampling  rate,  target, 
dynamics,  filter  memory  length,  and  noise  on  the  measurements. 
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QUADRATIC  POLYNOMIAL  FILTER 


1  •  Name  or  Acronym 

Quadratic  Polynomial  Filter 

2.  Contact  Dr.  Floyd  Hall 

Naval  Weapons  Center 
Code  62303 

China  Lake.  CA  93555 
(619)  939-6346 
DSN:  437-6346 

3 .  Documentation  Sources 

Gossett,  Eric.  "On-Axis  Tracking  System. 

4 .  Comments 


This  filter  works  quite  well  for  real-time  trajectory  data  from 
radar  or  laser  data.  The  quadratic  polynomial  filter  is  an  tc-jS-T 
filter  based  on  two  parameters.  This  filter  is  a  little  different 
from  what  is  expressed  in  Gossett's  paper  although  it  gives  the  same 
results.  The  filter  is  not  considered  adequate  for  close-in  targets 
with  tracking  radar  problems.  Naval  Weapons  Center  is  currently 
developing  a  filter  that  rectifies  this  inadequacy.  The  new  filter 
will  have  nonlinear  constraints. 
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QD  -  NATC 


1 •  Name  or  Acronym 

Quadratic  Digital  (QD)  Filter 

2.  Contact  Mf .  John  Shields 

Naval  Air  Tsft  Center 
Computer  Sciences  Division  (CSSS) 
Patuxent  River,  MD  20670-5304 
(301)  863-3396 
DSN:  326-3396 

3.  Documentation  Sources 


McCool,  W.  A.  "QD-A  New  Efficient  Digital  Filter.”  Analysis  and 
Computation  Directorate  Internal  Memorandum  60.  White  Sands 
Missile  Range:  Analysis  and  Computation  Directorate,  Aug.  1967. 

4.  Origin  Mr.  Frederick  K.  H.  Hoeck 

Computer  Services  Directorate 
Patuxent  River,  MD  20670-5304 
1979 

5 .  Comments 


This  filter  is  adequate  for  the  application;  however,  as  with  all 
filters,  there  is  some  setting  time.  Comparisons  made  to  other  data 
sources  were  favorable.  The  filter  requires  little  memory  because 
samples  need  not  be  stored.  Constants  need  to  be  calculated  based  on 
sample  rate  and  number  of  points  In  the  point  span.  It  handles  data 
errors  and  recovers  with  few  problems. 
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AVRAGE 


t •  Name  or  Acronym 
AVRAGE 

2.  Contact  Mr.  Ly  V.  Tran 

6521  Range  Squadron/RCP 
EdMiarda  AFB.  CA  93623*-5000 
(806)  277-0871 
DSN:  627-0871 

3.  Documentation  Souroaa 

Computer  Sciences  Branch,  6621  Range  Squadron,  6510  Test  Wing. 
"Average  Data  Smoothing  Subroutine."  Un i form  F I i ght  Test 
Anatvsis  System  (UFTAS)  Reference  Manual.  Chapter  8.  Version 
3.1.  Edwards  Air  Force  Base:  Air  Force  Flight  Tost  Center, 
October  1990. 

4.  Origin  Systems  Development  Corporation 

June  1972 

6.  Comments 

The  AVRAGE  gives  an  average  of  up  to  61  consecutive  input  data 
values. 
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0UZ2 


1 .  Name  or  Acronym 

Differentiation  by  Least  Squares  Subroutine  (DUZ2) 


2. 


Contact  Mr.  Ly  V.  Tran 

6621  Range  Squadron/RCP 
Edwards  APB.  CA  93523 
(80S)  277-0871 
DSN:  627-0871 


Mr.  Mike  Tietz 

Computer  Sciences  Corporation 

P.O.  Box  446 

Edwards  APB.  CA  93523 

(806)  277-3800 

DSN:  627-3800 


3.  Documentation  Sources 

Computer  Sciences  Branch.  6621  Range  Squadron,  6510  Test  Wing. 
"Differentiation  by  Least  Squares  Subroutine  (DUZ2’)  . "  Un  I  form 
Plight  Test  Analysis  System  (UPTAS)  Reference  Manual.  Chapter  20. 
Version  3.1.  Edwards  Air  Pores  Base:  Air  Porce  Plight  Test  Center, 
October  1990. 


4.  Comments 

The  DUZ2  calculates  smooth  values  as  well  as  first  and  second 
derivatives  by  fitting  a  least  squares  parabola.  This  subroutine 
works  well  with  low-angular  acceleration  but  not  with  high-angular 
accelerations.  It  is  limited  in  how  much  data  can  be  processed  in  one 
call  to  the  subroutine  by  the  array  sizes,  because  an  excessive  amount 
of  computer  memory  could  be  required. 
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SDIFFR 


1 .  Nairw  or  Acronym 

Differentiation  Subroutine  (SDIFFR) 

2.  Contact  Mr.  Ly  V.  Tran 

6521  Ranga  Squadron/RCP 
Edveardn  AFB.  CA  63523>6000 
(805)  277-0871 
DSN:  527-0871 

3.  Documentation  Souroaa 


Computer  Sciencea  Branch.  6521  Range  Squadron,  6510  Test  Wing. 

"Differentiation  Subroutine  (SDIFFR)."  Uniform  Flight  Test 

Analvaia  System  (UFTAS)  Reference  Manual.  Chapter  20.  Version 

3.1.  Edwards  Air  Force  Base:  Air  Force  Flight  Test  Center, 

October  1990. 

Origin  Messrs.  R.  C.  Schram  and  R.  T.  Scott 

White  Sands  Missile  Range 
New  Mex i co 
July  1972 

5.  Cotmienta 

Basically,  the  SDIFFR  functions  as  a  single-parameter,  cycling 
DIRSIT  which  c  sates  parameter  arrays  containing  up  to  60  time  points 
of  smooth  values,  first  derivatives,  and  second  derivatives  as  desired. 
Tl.e  SDIFFR  is  slightly  different  from  DIRSIT  In  that  it  's  called  once 
for  each  desired  parameter,  initializing  (if  rsq.iested)  ,  and  process¬ 
ing  up  to  60  points  and  then  returns.  Thus,  SDIFFR  cycles  up  to  60 
points  inside  itself  for  1  parameter  instead  of  being  called  up  to  60 
t imes . 

As  a  method  of  computation,  the  I  n  i  1 1  .i  I  i  zat  i  on  is  accomplished  by 
fitting  a  ieast  squares  parabola  and  using  a  maximum  likelihood  proce¬ 
dure  to  the  first  user-designated  interval  input  data  points.  The 
DIRSIT  process  then  takes  over  for  subsequent  points.  Because  this 
process  is  not  se I f-star t i ng ,  at  least  the  first  interval  of  points 
should  be  allowed  at  the  beginning  for  start-up.  Once  the  DIRSIT  pro¬ 
cess  begins,  a  second-order  Taylor  series  expansion  is  adjusted  ac¬ 
cording  to  certain  statistical  criteria  until  the  number  of  points 
above  the  curve  differs  from  the  number  below  the  curve  by  a  user- 
designated  amount. 

The  first  and  second  derivatives  of  the  resulting  second-order 
curve  are  taken  as  the  derivatives  at  the  first  of  the  interval.  The 
interval  is  then  moved  by  one  point,  and  the  process  continued  untii 
the  end  of  data  is  reached.  At  the  end  of  the  data,  the  interval  size 
is  collapsed  until  only  one  point  remains.  The  derivatives  for  the 
last  point  are  set  equal  to  the  derivative  of  the  next  to  the  last 
point.  Because  of  this  interval  collapsing,  up  to  INPTS-1  points 
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should  be  disregarded  at  the  end  of  the  data,  where  INPTS  is  the 
number  of  points  in  the  interval. 

A  wild  point  has  only  minimal  effect  on  the  DIRSit  process  since 
the  only  test  made  is  whether  It  is  above  or  below  the  curve.  How  far 
above  or  below  Is  of  little  importance. 

The  conditions  of  validity  are  listed  below. 

a.  Care  should  be  taken  to  avoid  processing  large  discontinu¬ 
ities:  however,  time  increments  need  not  necessarily  be  constant. 

b.  The  appropriate  slope  parameter  and  tolerance  criteria 
parameter  must  be  provided  to  ensure  valid  results. 

c.  The  number  of  input  data  points  per  parameter  is  limited  to 
60  for  each  call.  More  points  can  be  accommodated  through  multiple 
calls  to  SOI FFR . 

d.  The  SDIFFR  is  not  a  self-starting  routine.  The  initial¬ 
ization  process  requires  a  number  of  points  to  get  things  moving,  so 
the  first  several  time  points  of  derived  values  will  be  poor  approxi- 
mat I ons . 

e.  The  SDIFFR  uses  a  collapsing  technique  to  process  the  last 
Interval  of  time  points,  but  the  results  for  these  last  several  points 
(INPTS-1)  become  increasingly  degraded  as  SDIFFR  is  forced  to  work  on 
smaller  and  smaller  intervals. 

f.  The  calling  program  for  SDIFFR  uses  an  overlapping  technique 
to  avoid  including  the  invalid  results  at  the  beginning  and  end  of 
each  array  processed.  A  check  should  be  made  to  ensure  that  the 
overlap  is  adequate  so  that  no  major  discontinuities  appear  at  each 
over  lap  point. 

g.  The  calling  program  for  SDIFFR  uses  a  default  interval  size 
which  the  user  may  change. 
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DIRSIT 


Name  or  Acronym 

Derivative  I  nforms. ‘j  i  on  Recovery  by  a  Selective  Integration 
Technique  (DIRSIT) 

Contact  Mr.  Len  Childers 

6646  Test  Group/ENAC 
Bldg  1284 

Hill  AFB,  UT  84056 
(801)  777-8606 
DSN:  458-8606 

Documentat 1  on  Sources 

Utah  Test  and  Training  Range  postflight  data  reduction  documents 

Origin  Mr.  Len  Childers 

6545  Test  Group/ENAC 
Hill  AFB,  UT  84066-6000 
(Adaptation  of  SDIFFR) 


UFTAS  FILTER  OVERLAY 


1  •  Name  or  Acronym 

Uniform  Flight  Test  Analysis  System  (UFTAS)  Digital  Filtering 
Primary  Overlay  (FILTER) 

2 •  Contact  Dr .  Willi  am  Q .  K i t  to 

6521  Range  Squ^dron/RCP 
Edwards  AFB.  CA  93523 
(805)  277-3198 
DSN:  527-3198 

3 •  Documentation  Sources 

Computer  Sciences  Branch,  6521  Rang^  Squadron,  6510  Test  Wing. 
"UFTAS  Digital  Filtering  Primary  Overlay  (FILTER)."  Un i form 
Flight  Test  Analysis  System  (UFTAS)  Reference  Manual.  Version 
3.1.  Edwards  Air  Force  Base:  Air  Force  Flight  T^st  Center, 
Oct.  1990. 

4.  Origin  Dr.  Wi I  I  iam  G.  Kitto 

1982 


Mr.  Ly  V.  Tran 
6521  Range  Squadron/RCP 
Edwards  AFB,  CA  93623-5000 
(806)  277-0871 
DSN:  527-0871 


5.  Comments 


Currently,  this  filter  is  used  heavily  in  the  Frequency  Response 
Analysis  (FRA)  program.  (Butterworth  or  User  Supplied  Weight  Type 
f i I  ter  . ) 
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BET 


1  .  Name  or  Acronym 

Best  Estimate  of  Trajectory  (BET) 

2.  Contact  Mr.  Robert  Mai 

Yuma  Proving  Ground 
Attn:  STEYP-MT-TA 
Yuma,  AZ  85366 
(602)  328-3296 
DSN:  899-3296 

3.  Documentation  Sources 

Liebelt,  Paul  B.  An  Introduction  to  Optimal  Estimation. 
Reading:  Add ison-Wesiey,  1967. 

Origin  Mr.  Robert  Mai 

Yuma  Proving  Ground 
Attn:  STEYP-MAC 
Yuma.  AZ  65366 
1976 

• 

5.  Comments 


The  Kalman  filter  and  Rauch-Tung-Str i ebe I  smoother  take  range, 
range  rate,  azimuth,  elevation,  and  apparent  angle  measurements  from 
up  to  20  instruments  and  based  upon  a  priori  statistical  information 
about  the  trajectory,  the  measurements,  and  the  initial  conditions, 
optimal  estimates  of  the  stats  vector  are  computed  at  each  of  the 
measurement  times.  The  state  vector  size  is  expandable  from  the  basic 
three  components  (x,y,z  coordinate  system)  to  include  up  to  five 
derivatives:  measurement  source,  pitch,  yaw,  pitch  rate,  and  yaw  rate. 
Estimates  of  the  state  vector  are  optimal  in  the  sense  that  the  uncer¬ 
tainty  in  each  component  of  the  state  vector  is  minimized.  This  BET 
can  provide  excellent  results;  however,  the  results  are  only  as  good 
as  the  a  priori  statistioai  information.  For  applications  where 
knowledge  of  measurement  uncertainty  and  dynamics  in  the  trajectory 
are  well  known  or  easily  estimated,  then  the  BET  will  undoubtedly 
provide  very  close  to  the  absolute  best  estimate.  If  the  a  pr i or  i 
statistics  distort  the  truth,  then  the  BET  trajectory  will  be  dis¬ 
torted.  In  actual  practice  at  Yuma  Proving  Ground,  a  BET  trajectory 
is  derived  in  an  interactive  fashion.  Initial  runs  are  made  with  a 
priori  statistics  implying  more  uncertainty  than  is  actually  present. 
Then  analysis  of  the  measurement  residuals  and  estimated  dynamics  are 
used  to  refine  the  a  priori  estimates.  A  new  BET  trajectory  is  then 
generated  and  analysis  of  residuals  and  dynamics  undirtaken.  This 
process  continues  until  the  a  pr ior i  statistics  match  the  derived 
est i mates . 

There  are  significant  disadvantages  to  using  the  BET.  Althcugh 
the  program  setup  is  very  complex  and  tedious,  obtaining  a  priori 
statistical  information  is  often  perceived  as  an  art  rather  than  a 
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science.  Errors  in  setup  or  in  judgment  almost  always  have  a  detri¬ 
mental  effect  on  the  final  estimates.  in  addition,  computation  time 
is  very  long,  and  the  required  iterative  process  can  cause  data  turn¬ 
around  time  to  expand  to.  longer  than  two  weeks.  So  if  you  want  the 
very  best,  you  must  be  willing  to  pay  for  Itf 
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RTUF 


1  .  Name  or  Acronym 

Real-Time  Update  Filter  (RTUF) 

2.  Contact  Mr.  Andy  Roy  or  Joe  Warren 
Computer  Sciences  Raytheon 
Unit  2310 

Eastern  Space  and  Missiie 
Center 

Patrick  AFB,  FL  32925 
(407)  494-7133 
DSN:  864-71 33 


Mr.  J.  V .  Copp 
Computer  Sciences 
Raytheon 

Eastern  Space  and 
Miss! 1 e  Center 
Patr ick  AFB,  FL  32925 
(407)  853-7783 


3.  Origin  Ms.  Marie  Colmer  and  Mr.  Royal  Pepple 

RCA/MTP 

Eastern  Space  and  Missile  Center 

Patrick  AFB,  FL  32925 

1971 

4.  Conmenta 

This  filter  is  used  mainly  for  the  Missile  Precision  Instruction 
Radar  (MIPIR)  class  of  radars.  These  radars  are  large-scale.  The 
RTUF  is  recursive,  adaptive,  exponentially  weighted,  and  has  fading 
memory.  By  adaptive,  it  is  meant  that  the  filter  can  adjust  as  the 
data  gets  seemingly  noisier  or  less  noisy.  As  the  data  becomes 
noisier,  the  bandwidth  is  decreased,  and  as  the  data  becomes  less 
noisy  the  bandwidth  increases.  In  an  adaptive  filter,  the  coeffi¬ 
cients  of  the  terms  involving  the  difference  between  the  predicted 
value  and  the  given  raw  value  vary  with  time.  In  an  exponentially 
weighted  filter  such  as  this  one,  the  coefficients  have  the  time 
variable  as  part  of  their  exponents.  In  a  fading-memory  filter,  the 
memory  fades  with  time.  In  this  case,  the  memory  fades  exponentially, 
in  other  words,  newer  data  are  weighted  considerably  more  than  older 
data  when  predicting  a  new  value. 

The  RTUF  is  a  simple  filter  because  it  does  not  work  with  partial 
derivatives  or  matrices.  For  this  reason,  Mr.  Joe  Warren  says  that 
this  filter  was  good  in  the  1960s  when  computers  were  slower  and  had 
less  memory.  Mr.  Warren  predicts  that  no  more  RTUFs  will  be  used 
within  two  to  three  years  and  suggests  using  a  Kalman-type  filter  in 
lieu  of  this  one . 
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RF I LTR 


1 .  Name  or  Acronym 

Real-Time  Software  System  (RFILTR) 

2-  Contact  Mr.  Robert  Crolene 

Pacific  Missile  Test  Center  (formerly  Pacific 
Missile  Range  (PMR)) 

Code  1074 

Point  Mugu,  CA  93042 
(805)  982-8073 
DSN:  351-8073 

3.  Documentation  Sources 

Cragun,  G.  C.  "Real-Time  Data  Filtering."  PMR  Tech  Note 
3285-576.  Point  Mugu:  Pacific  Missile  Renge. 

4.  Or Iqin  NAMTC 

Code  3400 
1965 

5.  Comments 


The  RFILTR  is  a  simple,  exponential  adaptive  filter.  The  advan¬ 
tage  of  this  filter  is  its  simplicity.  Upgrading  can  be  achieved  with 
some  adaptive  smoothing  controls  by  basing  it  on  residuals  or  by 
employing  a  Kalman  algorithm.  However,  this  step  would  complicate 
filter  operations  and  may  not  be  practical  for  the  software  system  of 
the  Univac  1230  for  which  this  filter  was  originally  designed.  Up¬ 
grading  the  filter  for  use  in  a  mainframe  computer  should  present  no 
prob I ems . 

Major  problems  with  this  filter  are  smoothing  control  and  ini¬ 
tialization  variance  control.  Correcting  one  control  usually  makes 
the  other  one  worse.  Initialization  errors  are  especially  large  for 
velocities  and  accelerations. 
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RCHECK 


1 •  Name  or  Acronym 

Rate  Check  Data  Smoothing  Subrc  i ne  (RCHECK) 

2.  Contact  Mr.  Ly  V.  Tran 

6621  Range  Squadron/RCP 
Edwards  AFB.  CA  93523-6000 
(806)  277-0871 
DSN:  627-0871 

3.  Documentation  Sourcaa 

Computer  Sciences  Branch,  6521  Range  Squadron,  6510  Test  Wing. 
"Rate  Check  Data  Smoothing  Subroutine  (RCHECK)."  Un i form  F I i ght 
Test  Analysis  System  (UFTAS)  Reference  Manual.  Chapter  8.  Ver¬ 
sion  3.1.  Edwards  Air  Force  Base:  Air  Force  Flight  Test  Center, 
October  1990. 

4.  Origin  Mr.  G.  A.  Lott 

Lockheed-Georg I  a  Company 
June  1972 

The  RCHECK  was  successfully  used  by  the  Lockheed-Georg i a  Company 
In  processing  C-6A  teat  data  and  was  later  modified  to  fit  Into  UFTAS. 

6.  Comments 


This  subroutine  searches  for  wild  points  by  comparing  DLY,  the 
absolute  difference  between  the  current  and  previous  point  values, 
with  TOL,  a  linear  function  of  the  average  of  successive  differences 
within  a  given  interval.  The  TOL  represents  the  tolerance  limit  for 
the  interval’s  data  variations.  The  mul t Ipl icat ive  and  additive 
factors  of  this  linear  function  are  user-supplied.  The  TOL  is 
increased  or  decreased  from  point  to  point  according  as  DLY  is  greater 
than  or  less  than  TOL.  in  addition,  if  DLY  is  greater  than  or  equal 
to  TOL,  the  current  data  value  is  replaced  by  the  last  valid  one. 
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EYBALL 


1 .  Name  or  Acronym 

Eyball  Data  Smoothing  Subroutine  (EYBALL) 

2-  Contact  Mr.  Ly  V.  Tran 

6521  Range  Squadron/RCP 
Edwards  AfB  CA  63523-6000 
(806)  277-0871 
DSN:  627-0871 

3.  Documentation  Sources 

Computer  Sciences  Branch.  6521  Range  Squadron.  6510  Test  U/ing. 
"Eyball  Data  Smoothing  Subroutine  (EYBALL)."  Uniform  Flight  Test 
Analysis  System  (UFTAS)  Reference  ii<anual.  Version  3.1.  Edwards 
Air  Force  Base:  Air  Force  Flight  Test  Center,  October  1990. 

Origin  Mr.  C.  F.  Carpenter  Capt  J.  H.  Pierson,  USAF 

General  Dynamics  Edwards  AFB,  CA 

July  1972 


5.  Cocrments 


The  user  specifies  a  value  DELTA  that  represents  the  difference 
between  the  maximum  and  minimum  values  for  a  given  parameter.  The 
value  of  DELTA  is  based  on  the  user's  prior  knowledge  of  what  values 
the  parameter  should  take. 

If  the  actual  range  of  values  within  the  interval  is  less  than  or 
equal  to  DELTA,  then  the  output  parameter  value  is  the  average  of  the 
values  in  the  interval.  If  the  range  is  greater  than  DELTA,  then  the 
weighted  average  of  the  most  common  values  in  the  interval,  with  the 
more  central  values  given  the  greater  weight.  Is  the  output  parameter 
value. 

The  advantages  of  the  EYBALL  subroutine  are 

a.  the  EYBALL  closely  approximates  intuitive  treatment  of  data, 

b.  the  user  has  control  by  using  prior  knowledge  of  the 
parameter , 

c.  the  wild  points  are  discarded  before  determination  of  the 
output  parameter  value,  and 

d.  the  excessive  wild  points  are  identified. 
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ON-AXIS 


1 .  Name  or  Acronym 

$ 

On-Axis  Radar  Target  Tracking  System  (ON-AXIS) 

2.  Contact  Mr.  John  E.  Llndagren 

3200  SPTW/KRTAR 
Egl in  AFB,  FL  32542 
(904)  082-4267 
DSN:  872-4267 

3.  Documentation  Sources 

"On-Ax  is:  Ph i I osophy/Techno I ogy/Deve I opment . "  Advanced  Research 
Project  Agency,  Radar  Microwave  Link  Tech  Memo  211.  Patrick  AFB 
Advanced  Research  Project  Agency,  Radar  Microwave  Link,  15  Dec 
1970. 

4.  Or Iq in  Advanced  Research  Project  Agency,  Radar 

Microwave  Link 
Patrick  AFB,  Florida 
1969 

Modified:  Air  Force  Development  Test  Center 

AFDTC/KR 

Egl in  AFB,  Florida 
1973 

5 .  Cotnnenta 


Strengths  of  this  filter  include  self-calibration  capability 
through  stellar  track;  adaptive  track  gain  with  smooth,  low-noise 
track;  and  predetermined  missile  trajectory  slew  at  launch. 

This  filter’s  weaknesses  cons ist  of  requ i r i ng  a  well -qua I  i f i ed 
crew  and  careful  maintenance  and  software  control  of  the  computer 
system  and  data  base.  The  On-Axis  track  accuracy  (with  pedestai  pos i 
tion  pick-offs)  offers  no  significant  Improvement  over  normal 
AN/FPS-16  TSPl  for  aerodynamic  maneuvering  targets  if  standard  post¬ 
mission  smoothing  procedures  (moving-arc-polynomial  midpoint  fits  to 
raw  data)  are  used. 
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DYN043 


1 •  Name  or  Acronym 

DYN043 

2*  Contact  Mr.  Robert  Fierro 

U.S.  Army  White  Sands  Missile  Range 
Attn;  STEWS-NR-AM 

White  Sands  Missile  Range,  NM  86002 
(606)  678-2643 
DSN:  268-2643 

3.  Documentation  Sources 

a.  Comstock,  D. ,  M-  Wright,  and  V.  Tipton.  "Handbook  of  Data 
Reduction  Methods."  Data  Reduction  Division  Tech  Rept.  White 
Sands  Missile  Range:  Data  Reduction  Division,  13  Aug  1964. 

b.  Comstock  D.  Introduction  to  Least  Squares.  White  Sands 
Missile  Range;  Analysis  and  Computation  Directorate,  1968. 

4.  Origin  Classical  Least  Squares  Smoothing 

August  1970 


5 .  Comments 


The  filter  derives  smooth  data  from  observation  using  the  least 
squares  moving  arc  method.  The  smoothed  positions  are  differentiated 
to  obtain  velocities  which,  in  turn,  are  differentiated  to  obtain 
acce I erat i ons. 
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GNFL 


B.  ComnentB 

Thic  filter  is  designed  to  give  a  frequency  response  with  sharper 
roll-off  and  with  increased  attenuation  at  higher  frequencies  when 
compared  to  standard  least  squares  polynomial  filters. 
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6NSM 


1 .  Name  or  Acronym 

Gennery  Smoother  (GNSM) 

Con^.act  Dr.  Kenneth  Lane 

CSR  3200 
P.O.  Box  4127 
Patrick  APB.  FL  32925 

3.  Documentation  Sourcaa 


a.  Computer  Program  586,  GNSM 

b.  Gennery,  Donald  B.  "Direct  Digital  Filters  for  General 
Purpose  Use."  RCA  Document.  Patrick  AFB:  RCA/MTP,  Jan. 
1966. 

Origin  Mr.  Donald  B.  Gennery 

1966 


B.  Comments 

Designed  as  an  improvement  of  the  GNFL  filter  with  sharper  roll 
off,  this  filter  has  the  additiora^l  feature  of  being  able  to  bridge 
discontinuities  in  the  derivatives  of  the  input  data. 
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FIRFILT 


1 .  Name  or  Acronym 

Finite  Impulse  Response  Filter  (FIRFILT) 

Contact  Mr.  Jerry  Biedscheid 

Sandia  National  Laboratories 
Division  7522 
P.O.  Box  5800 
Albuquerque,  NM  87185 
(505)  844-4048 
DSN:  244-4048 

3.  Documentation  Sourcaa 

McClellan,  James  A.,  Thomas  W.  Parks,  and  Lawrence  R.  Rabiner. 

"A  Computer  Program  for  Designing  Optimum  FIR  Linear  Phase 
Digital  Filters."  IEEE  Trans.  Audio  E I ectroacoust .  AU-21.6 

(1973):  506-26. 

4.  Origin  Mr.  D.  J.  Miller 

Sandia  National  Laboratories 
Division  1414 
P.O.  Box  5800 
Albuquerque,  NM  87165 
1980 

5.  Cownents 

This  filter  gives  good  results  in  low  dynamic  situations,  but  the 
filter  is  difficult  to  control. 


A-41 


flECFiLT 


B.  Comments 

This  filter  provid^es  excellent  results,  psrticulfrly  with  large 
data  sets  using  the  phase  shift  removal  option. 
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FIUKIAX 


1  •  Name  or  Acronym 

F I LMAX 

2.  Contact  Mr.  D.  0.  Smallwood 

Sand i a  National  Laboratories 
Division  7544 
P.O.  Box  5600 
Aibuquerque,  NM  87185 
(605)  844-1074 
DSN:  244-1074 

3.  Documentation  Sources 

Smallwood,  D.  0.  "An  Improved  Recursive  Formula  for  Calculating 
Shock  Response  Spectra."  Shock  and  Vibration  Bulletin.  61.2 
(1981) :  211-17. 

Origin  Mr.  D.  0.  Smallwood 

Sand i a  National  Laboratories 

Division  7544 

1979 

5.  Comments 


The  older  recursive  models  of  this  filter  used  for  calculat¬ 
ing  the  shock  response  spectra  resulted  in  significant  errors  when  the 
natural  frequency  exceeded  one-sixth  of  the  sample  rate.  This  new 
filter  avoids  the  problem. 
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MDPTB1 


1  -  Name  or  Acronym 

MDPT51 

2.  Contact  Mr.  J.  A.  Ward 

Eastern  Space  and  Missile  Center 
RCA/MTP 

Patrick  APB,  FL  32935 

3.  Documentation  Sources 


a.  RAiD  Computer  Program 

b.  "Filtering  Tracking  Data  for  Range  Safety  Displays." 
Document.  Patrick  AFB:  RCA/MTP,  Jan.  1984. 


RCA 
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Bsm 


1 •  Name  or  Acronym 
BSMW 

2.  Contact  Mr.  J.  A.  Ward 

Computer  Sciences  Raytheon 
Eastern  Space  and  Missile  Center 
Patrick  AFB,  FI.  32926 

3.  Documentation  Sources 

a.  RAID  Computer  Program 

b.  “Filtering  Tracking  Data  for  Range  Safety  Displays."  RCA 
Document.  Patrick  AFB:  RCA/MTP,  January  1984. 

4.  Comnents 

The  BSMW  is  a  quadratic  filter  that  is  recursive  but  not  adap¬ 
tive.  (A  nonadaptive  filter  is  a  filter  with  a  fixed  bandwidth.  The 
coefficients  of  the  terms  involving  the  difference  between  the  pre¬ 
dicted  value  and  the  given  raw  value  are  constant;  they  do  not  vary 
with  the  perceived  noise  content  of  the  data.) 
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sum 


2.  Contact  Mr.  J.  A.  Ward 

Computer  Sciences  Raytheon 
Eastern  Space  and  Missile  Center 
Patrick  AFB,  FL  32925 

3 .  Documentation  Sources 

a.  RAID  Computer  Program 

b.  "Filtering  Tracking  Data  for  Range  Safety  Displays."  RCA 
Document.  Patrick  AFB:  RCA/MTP,  January  1984. 

4.  Coninents 

The  SMW  is  a  linear  filter  that  is  recursive  but  not  adaptive. 

(A  nonadaptive  filter  is  a  filter  v  i th  a  fixed  bandwidth.  The  coeffi¬ 
cients  of  the  terms  involving  the  difference  between  the  predicted 
value  and  the  given  raw  value  are  constant;  they  do  not  vary  with  the 
perceived  noise  content  of  the  data.) 
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FREQUENCY  RESPONSE  ANALYSIS 


1 .  Name  or  Acronym 

Frequency  Response  Analysis  (FRA) 

2.  Contact  Mr.  Barry  Mishler 

6521  Range  Squadron/RCP 
Edwards,  CA  93523-5000 
(005)  277-6040 
DSN:  527-6040 


3 .  Documentation  Sources 


Computer  Sciences  Branch,  6521  Range  Squadron,  6510  Test  Wing, 
"Frequency  Response  Analysis  (FRA)  Overlay."  Uniform  Flight  Test 
Analysis  System  (UFTAS)  Reference  Manual.  Version  3.1,  Edwards 
Air  Force  Base:  Air  Force  Flight  Test  Center,  Oct.  1990. 


4.  Origin  Mr .  Tom  Twisdal e 

6510  Test  Wing/DOEF 
Edwards  AFB,  CA  93523-5000 
(805)  277-1240 
DSN:  527-1248 


Dr .  W i I  I  i am  G .  K i tto 
6521  Range  Squadron/RCP 
Edwards  AFB,  CA  93523-5000 
(805)  277-3198 
DSN:  527-3190 


5.  Comments 


The  Frequency  Response  Analysis  program  transfers  the  dynamic 
time  domain  data  into  the  frequency  domain  to  do  the  frequency 
response  analysis  specified  by  the  user.  Power  spectral  densities, 
transfer  functions,  and  coherence  functions  can  be  calculated  in  the 
frequency  domain.  The  dynamic  time  domain  data  are  contained  on  either 
a  B-file  or  a  C-file.  After  the  desired  analysis  is  complete,  FRA  can 
put  the  frequency  domain  results  back  into  the  time  domain. 

The  FRA  program  is  not  a  filter.  This  program  is  meant  to  aid 
the  user  in  determining  what  filter  to  use  and  how  to  use  it.  For 
instance,  the  FRA  can  aid  in  determining  what  cutoff  frequencies 
should  be  in  the  frequency  spectrum  or  if  the  filter  should  be  band- 
limited  or  nonband  I  im i ted ,  At  the  present  time,  the  program  cannot 
accept  more  than  1024  time  points.  It  uses  the  first  1024  time  points 
received  and  discards  the  rest  of  the  points. 
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